The Conversational Interface

This book provides a comprehensive introduction to the conversational interface, which is becoming the main mode of interaction with virtual personal assistants, smart devices, various types of wearable, and social robots. The book consists of four parts. Part I presents the background to conversational interfaces, examining past and present work on spoken language interaction with computers. Part II covers the various technologies that are required to build a conversational interface along with practical chapters and exercises using open source tools. Part III looks at interactions with smart devices, wearables, and robots, and discusses the role of emotion and personality in the conversational interface. Part IV examines methods for evaluating conversational interfaces and discusses future directions.

Voice user interfaces (VUIs) are becoming all the rage today. But how do you build one that people can actually converse with? Whether you’re designing a mobile app, a toy, or a device such as a home assistant, this practical book guides you through basic VUI design principles, helps you choose the right speech recognition engine, and shows you how to measure your VUI’s performance and improve upon it. Author Cathy Pearl also takes product managers, UX designers, and VUI designers into advanced design topics that will help make your VUI not just functional, but great.Understand key VUI design concepts, including command-and-control and conversational systemsDecide if you should use an avatar or other visual representation with your VUIExplore speech recognition technology and its impact on your designTake your VUI above and beyond the basic exchange of informationLearn practical ways to test your VUI application with usersMonitor your app and learn how to quickly improve performanceGet real-world examples of VUIs for home assistants, smartwatches, and car systems

Build over 8 chatbots and conversational user interfaces with leading tools such as Chatfuel, Dialogflow, Microsoft Bot Framework, Twilio, Alexa Skills, and Google Actions and deploying them on channels like Facebook Messenger, Amazon Alexa and Google Home About This Book Understand the different use cases of Conversational UIs with this project-based guide Build feature-rich Chatbots and deploy them on multiple platforms Get real-world examples of voice-enabled UIs for personal and home assistance Who This Book Is For This book is for developers who are interested in creating interactive conversational UIs/Chatbots. A basic understanding of JavaScript and web APIs is required. What You Will Learn Design the flow of conversation between the user and the chatbot Create Task model chatbots for implementing tasks such as ordering food Get new toolkits and services in the chatbot ecosystem Integrate third-party information APIs to build interesting chatbots Find out how to deploy chatbots on messaging platforms Build a chatbot using MS Bot Framework See how to tweet, listen to tweets, and respond using a chatbot on Twitter Publish chatbots on Google Assistant and Amazon Alexa In Detail Conversation as an interface is the best way for machines to interact with us using the universally accepted human tool that is language. Chatbots and voice user interfaces are two flavors of conversational UIs. Chatbots are real-time, data-driven answer engines that talk in natural language and are context-aware. Voice user interfaces are driven by voice and can understand and respond to users using speech. This book covers both types of conversational UIs by leveraging APIs from multiple platforms. We'll take a project-based approach to understand how these UIs are built and the best use cases for deploying them. We'll start by building a simple messaging bot from the Facebook Messenger API to understand the basics of bot building. Then we move on to creating a Task model that can perform complex tasks such as ordering and planning events with the newly-acquired-by-Google Dialogflow and Microsoft Bot framework. We then turn to voice-enabled UIs that are capable of interacting with users using speech with Amazon Alexa and Google Home. By the end of the book, you will have created your own line of chatbots and voice UIs for multiple leading platforms. Style and approach This is a practical book, where each chapter focuses on a chatbot project. The chapters take a step-by-step approach to help you build intelligent chatbots that act as personal assistants.

Spoken Dialogue Technology provides extensive coverage of spoken dialogue systems, ranging from the theoretical underpinnings of the study of dialogue through to a detailed look at a number of well-established methods and tools for developing spoken dialogue systems. The book enables students and practitioners to design and test dialogue systems using several available development environments and languages, including the CSLU toolkit, VoiceXML, SALT, and XHTML+ voice. This practical orientation is usually available otherwise only in reference manuals supplied with software development kits. The latest research in spoken dialogue systems is presented along with extensive coverage of the most relevant theoretical issues and a critical evaluation of current research prototypes. A dedicated web site containing supplementary materials, code, links to resources will enable readers to develop and test their own systems (). Previously such materials have been difficult to track down, available only on a range of disparate web sites and this web site provides a unique and useful reference source which will prove invaluable.

With recent advances in natural language understanding techniques and far-field microphone arrays, natural language interfaces, such as voice assistants and chatbots, are emerging as a popular new way to interact with computers. They have made their way out of the industry research labs and into the pockets, desktops, cars and living rooms of the general public. But although such interfaces recognize bits of natural language, and even voice input, they generally lack conversational competence, or the ability to engage in natural conversation. Today’s platforms provide sophisticated tools for analyzing language and retrieving knowledge, but they fail to provide adequate support for modeling interaction. The user experience (UX) designer or software developer must figure out how a human conversation is organized, usually relying on commonsense rather than on formal knowledge. Fortunately, practitioners can rely on conversation science. This book adapts formal knowledge from the field of Conversation Analysis (CA) to the design of natural language interfaces. It outlines the Natural Conversation Framework (NCF), developed at IBM Research, a systematic framework for designing interfaces that work like natural conversation. The NCF consists of four main components: 1) an interaction model of “expandable sequences,” 2) a corresponding content format, 3) a pattern language with 100 generic UX patterns and 4) a navigation method of six basic user actions. The authors introduce UX designers to a new way of thinking about user experience design in the context of conversational interfaces, including a new vocabulary, new principles and new interaction patterns. User experience designers and graduate students in the HCI field as well as developers and conversation analysis students should find this book of interest.

As voice interfaces and virtual assistants have moved out of the industry research labs and into the pockets, desktops and living rooms of the general public, a demand for a new kind of user experience (UX) design is emerging. Although the people are becoming familiar with Siri, Alexa, Cortana and others, their user experience is still characterized by short, command- or query-oriented exchanges, rather than longer, conversational ones. Limitations of the microphone and natural language processing technologies are only part of the problem. Current conventions of UX design apply mostly to visual user interfaces, such as web or mobile; they are less useful for deciding how to organize utterances, by the user and the virtual agent, into sequences that work like those of natural human conversation. This edited book explores the intersection of UX design, of both text- or voice-based virtual agents, and the analysis of naturally occurring human conversation (e.g., the Conversation Analysis, Discourse Analysis and Interactional Sociolinguistics literatures). It contains contributions from researchers, from academia and industry, with varied backgrounds working in the area of human-computer interaction. Each chapter explores some aspect of conversational UX design. Some describe the design challenges faced in creating a particular virtual agent. Others discuss how the findings from the literatures of the social sciences can inform a new kind of UX design that starts with conversation.

Learn how to incorporate your own conversational interfaces into iOS applications. This book will help you work comfortably multiple frameworks, including Apple's Speech and SiriKit frameworks; Google's API.AI conversational interfaces platform; and Facebook’s Wit.ai. You'll explore the basics of natural language processing on iOS and see how to develop sentiment analysis with Apple's new Core ML framework. You'll also understand the primary challenges of conversational interfaces, and how to future proof your design. With the introduction of SiriKit and the Speech framework, iOS developers now have huge opportunities to incorporate conversational interfaces into their apps. The latest advancements in natural language processing and machine learning allow for the development of complex conversational interfaces. This book incorporates all aspects of conversational interfaces on iOS—from voice transcription to natural language processing and entities extraction to text to speech commands. What You'll Learn Integrate intelligent voice interfaces into iOS applications Use frameworks to enable voice reactive iOS applications Future proof your interface by understanding the expected future trends of voice recognition Who This Book Is For Primarily iOS developers, product and innovation managers, and UX experts. It will also be helpful to all developers/managers that want to provide conversational interfaces in their apps.

Welcome to the future, where you can talk with the digital things around you: voice assistants, chatbots, and more. But these interactions can be unhelpful and frustrating—sometimes even offensive or biased. Conversations with Things teaches you how to design conversations that are useful, ethical, and human–centered—because everyone deserves to be understood, especially you.