An Evaluation Framework For Multimodal Interaction

This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.

This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.

Our perception of our everyday interactions is shaped by more than what is said. From coffee with friends to interviews, meetings with colleagues and conversations with strangers, we draw on both verbal and non-verbal behaviour to judge and consider our experiences. Analyzing Multimodal Interaction is a practical guide to understanding and investigating the multiple modes of communication, and provides an essential guide for those undertaking field work in a range of disciplines, including linguistics, sociology, education, anthropology and psychology. The book offers a clear methodology to help the reader carry out their own integrative analysis, equipping them with the tools they need to analyze a situation from different points of view. Drawing on research into conversational analysis and non-verbal behaviour such as body movement and gaze, it also considers the role of the material world in our interactions, exploring how we use space and objects - such as our furniture and clothes - to express ourselves. Considering a range of real examples, such as traffic police officers at work, doctor-patient meetings, teachers and students, and friends reading magazines together, the book offers lively demonstrations of multimodal discourse at work. Illustrated throughout and featuring a mini-glossary in each chapter, further reading, and advice on practical issues such as making transcriptions and video and audio recordings, this practical guide is an essential resource for anyone interested in the multiple modes of human interaction.

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness. Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

The four LNCS volume set 9175-9178 constitutes the refereed proceedings of the 9th International Conference on Learning and Collaboration Technologies, UAHCI 2015, held as part of the 17th International Conference on Human-Computer Interaction, HCII 2015, in Los Angeles, CA, USA in August 2015, jointly with 15 other thematically similar conferences. The total of 1462 papers and 246 posters presented at the HCII 2015 conferences were carefully reviewed and selected from 4843 submissions. These papers of the four volume set address the following major topics: LNCS 9175, Universal Access in Human-Computer Interaction: Access to today's technologies (Part I), addressing the following major topics: LNCS 9175: Design and evaluation methods and tools for universal access, universal access to the web, universal access to mobile interaction, universal access to information, communication and media. LNCS 9176: Gesture-based interaction, touch-based and haptic Interaction, visual and multisensory experience, sign language technologies, and smart and assistive environments LNCS 9177: Universal Access to Education, universal access to health applications and services, games for learning and therapy and cognitive disabilities and cognitive support and LNCS 9178: Universal access to culture, orientation, navigation and driving, accessible security and voting, universal access to the built environment and ergonomics and universal access.

This book focuses on the importance of human factors in the development of safe and reliable unmanned systems. It discusses current challenges such as how to improve the perceptual and cognitive abilities of robots, develop suitable synthetic vision systems, cope with degraded reliability in unmanned systems, predict robotic behavior in case of a loss of communication, the vision for future soldier-robot teams, human-agent teaming, real-world implications for human-robot interaction, and approaches to standardize both the display and control of technologies across unmanned systems. Based on the AHFE 2017 International Conference on Human Factors in Robots and Unmanned Systems, held on July 17–21 in Los Angeles, California, USA, this book is expected to foster new discussion and stimulate new advances in the development of more reliable, safer, and highly functional devices for carrying out automated and concurrent tasks.

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers. Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way; Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted living, language learning, and health care; Features illustrative examples of implementations that use the standards, to help spark innovative ideas for future applications.

Volume LNCS 13516 is part of the refereed proceedings of the 24th International Conference on Human-Computer Interaction, HCII 2022, which was held virtually during June 26 to July 1, 2022. A total of 5583 individuals from academia, research institutes, industry, and governmental agencies from 88 countries submitted contributions, and 1276 papers and 275 posters were included in the proceedings that were published just before the start of the conference. Additionally, 296 papers and 181 posters are included in the volumes of the proceedings published after the conference, as “Late Breaking Work” (papers and posters). The contributions thoroughly cover the entire field of human-computer interaction, addressing major advances in knowledge and effective use of computers in a variety of application areas.