Robust Multimodal Cognitive Load Measurement

This book explores robust multimodal cognitive load measurement with physiological and behavioural modalities, which involve the eye, Galvanic Skin Response, speech, language, pen input, mouse movement and multimodality fusions. Factors including stress, trust, and environmental factors such as illumination are discussed regarding their implications for cognitive load measurement. Furthermore, dynamic workload adjustment and real-time cognitive load measurement with data streaming are presented in order to make cognitive load measurement accessible by more widespread applications and users. Finally, application examples are reviewed demonstrating the feasibility of multimodal cognitive load measurement in practical applications. This is the first book of its kind to systematically introduce various computational methods for automatic and real-time cognitive load measurement and by doing so moves the practical application of cognitive load measurement from the domain of the computer scientist and psychologist to more general end-users, ready for widespread implementation. Robust Multimodal Cognitive Load Measurement is intended for researchers and practitioners involved with cognitive load studies and communities within the computer, cognitive, and social sciences. The book will especially benefit researchers in areas like behaviour analysis, social analytics, human-computer interaction (HCI), intelligent information processing, and decision support systems.

Cognitive Load Measurement and Application provides up-to-date research and theory on the functional role of cognitive load measurement and its application in multimedia and visual learning. Grounded in a sound theoretical framework, this edited volume introduces methodologies and strategies that effect high-quality cognitive load measurement in learning. Case studies are provided to aid readers in comprehension and application within various learning situations, and the book concludes with a review of the possible future directions of the discipline.

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces: user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces that often include biosignals. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This second volume of the handbook begins with multimodal signal processing, architectures, and machine learning. It includes recent deep learning approaches for processing multisensorial and multimodal user data and interaction, as well as context-sensitivity. A further highlight is processing of information about users' states and traits, an exciting emerging capability in next-generation user interfaces. These chapters discuss real-time multimodal analysis of emotion and social signals from various modalities, and perception of affective expression by users. Further chapters discuss multimodal processing of cognitive state using behavioral and physiological signals to detect cognitive load, domain expertise, deception, and depression. This collection of chapters provides walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this rapidly expanding field. In the final section of this volume, experts exchange views on the timely and controversial challenge topic of multimodal deep learning. The discussion focuses on how multimodal-multisensor interfaces are most likely to advance human performance during the next decade.

This book includes impactful chapters which present scientific concepts, frameworks, architectures and ideas on sensing technologies and machine learning techniques. These are relevant in tackling the following challenges: (i) the field readiness and use of intrusive sensor systems and devices for capturing biosignals, including EEG sensor systems, ECG sensor systems and electrodermal activity sensor systems; (ii) the quality assessment and management of sensor data; (iii) data preprocessing, noise filtering and calibration concepts for biosignals; (iv) the field readiness and use of nonintrusive sensor technologies, including visual sensors, acoustic sensors, vibration sensors and piezoelectric sensors; (v) emotion recognition using mobile phones and smartwatches; (vi) body area sensor networks for emotion and stress studies; (vii) the use of experimental datasets in emotion recognition, including dataset generation principles and concepts, quality insurance and emotion elicitation material and concepts; (viii) machine learning techniques for robust emotion recognition, including graphical models, neural network methods, deep learning methods, statistical learning and multivariate empirical mode decomposition; (ix) subject-independent emotion and stress recognition concepts and systems, including facial expression-based systems, speech-based systems, EEG-based systems, ECG-based systems, electrodermal activity-based systems, multimodal recognition systems and sensor fusion concepts and (x) emotion and stress estimation and forecasting from a nonlinear dynamical system perspective. This book, emerging from the Special Issue of the Sensors journal on “Emotion and Stress Recognition Related Sensors and Machine Learning Technologies” emerges as a result of the crucial need for massive deployment of intelligent sociotechnical systems. Such technologies are being applied in assistive systems in different domains and parts of the world to address challenges that could not be addressed without the advances made in these technologies.

This book constitutes the refereed proceedings of the 14th Asian Conference on Intelligent Information and Database Systems, ACIIDS 2022, held Ho Chi Minh City, Vietnam in November 2022. The 113 full papers accepted for publication in these proceedings were carefully reviewed and selected from 406 submissions. The papers of the 2 volume-set are organized in the following topical sections: data mining and machine learning methods, advanced data mining techniques and applications, intelligent and contextual systems, natural language processing, network systems and applications, computational imaging and vision, decision support and control systems, and data modeling and processing for industry 4.0. The accepted and presented papers focus on new trends and challenges facing the intelligent information and database systems community.

This book reports research and development that represent the state of the art in artificial intelligence in design, design cognition, design neurocognition, and design theories from the Tenth International Conference on Design Computing and Cognition held in Glasgow, UK, in 2022. The 48 chapters are grouped under the headings of natural language processing and design; design cognition; design neurocognition; learning and design; creative design and co-design; shape grammars; quantum computing; and human behavior. These contributions are of particular interest to design researchers and design educators, as well as to users of advanced computation and cognitive science. This book contains knowledge about the cognitive and neurocognitive behavior of designers, which is valuable to those who need to gain a better understanding of designing.

This two-volume set LNAI 12163 and 12164 constitutes the refereed proceedings of the 21th International Conference on Artificial Intelligence in Education, AIED 2020, held in Ifrane, Morocco, in July 2020.* The 49 full papers presented together with 66 short, 4 industry & innovation, 4 doctoral consortium, and 4 workshop papers were carefully reviewed and selected from 214 submissions. The conference provides opportunities for the cross-fertilization of approaches, techniques and ideas from the many fields that comprise AIED, including computer science, cognitive and learning sciences, education, game design, psychology, sociology, linguistics as well as many domain-specific areas. ​*The conference was held virtually due to the COVID-19 pandemic.

This book constitutes the refereed proceedings of the 13th International Conference on Computational Collective Intelligence, ICCCI 2021, held in September/October 2021. The conference was held virtually due to the COVID-19 pandemic. The 58 full papers were carefully reviewed and selected from 230 submissions. The papers are grouped in topical issues on knowledge engineering and semantic web; social networks and recommender systems; collective decision-making; cooperative strategies for decision making and optimization; data mining and machine learning; computer vision techniques; natural language processing; Internet of Things: technologies and applications; Internet of Things and computational technologies for collective intelligence; computational intelligence for multimedia understanding.