Deep Learning Techniques Applied To Affective Computing

Affective computing refers to computing that relates to, arises from, or influences emotions. The goal of affective computing is to bridge the gap between humans and machines and ultimately endow machines with emotional intelligence for improving natural human-machine interaction. In the context of human-robot interaction (HRI), it is hoped that robots can be endowed with human-like capabilities of observation, interpretation, and emotional expression. The research on affective computing has recently achieved extensive progress with many fields contributing including neuroscience, psychology, education, medicine, behavior, sociology, and computer science. Current research in affective computing concentrates on estimating human emotions through different forms of signals such as speech, face, text, EEG, fMRI, and many others. In neuroscience, the neural mechanisms of emotion are explored by combining neuroscience with the psychological study of personality, emotion, and mood. In psychology and philosophy, emotion typically includes a subjective, conscious experience characterized primarily by psychophysiological expressions, biological reactions, and mental states. The multi-disciplinary features of understanding “emotion” result in the fact that inferring the emotion of humans is definitely difficult. As a result, a multi-disciplinary approach is required to facilitate the development of affective computing. One of the challenging problems in affective computing is the affective gap, i.e., the inconsistency between the extracted feature representations and subjective emotions. To bridge the affective gap, various hand-crafted features have been widely employed to characterize subjective emotions. However, these hand-crafted features are usually low-level, and they may hence not be discriminative enough to depict subjective emotions. To address this issue, the recently-emerged deep learning (also called deep neural networks) techniques provide a possible solution. Due to the used multi-layer network structure, deep learning techniques are capable of learning high-level contributing features from a large dataset and have exhibited excellent performance in multiple application domains such as computer vision, signal processing, natural language processing, human-computer interaction, and so on. The goal of this Research Topic is to gather novel contributions on deep learning techniques applied to affective computing across the diverse fields of psychology, machine learning, neuroscience, education, behavior, sociology, and computer science to converge with those active in other research areas, such as speech emotion recognition, facial expression recognition, Electroencephalogram (EEG) based emotion estimation, human physiological signal (heart rate) estimation, affective human-robot interaction, multimodal affective computing, etc. We welcome researchers to contribute their original papers as well as review articles to provide works regarding the neural approach from computation to affective computing systems. This Research Topic aims to bring together research including, but not limited to: • Deep learning architectures and algorithms for affective computing tasks such as emotion recognition from speech, face, text, EEG, fMRI, and many others. • Explainability of deep Learning algorithms for affective computing. • Multi-task learning techniques for emotion, personality and depression detection, etc. • Novel datasets for affective computing • Applications of affective computing in robots, such as emotion-aware human-robot interaction and social robots, etc.

Affective computing is a nascent field situated at the intersection of artificial intelligence with social and behavioral science. It studies how human emotions are perceived and expressed, which then informs the design of intelligent agents and systems that can either mimic this behavior to improve their intelligence or incorporate such knowledge to effectively understand and communicate with their human collaborators. Affective computing research has recently seen significant advances and is making a critical transformation from exploratory studies to real-world applications in the emerging research area known as applied affective computing. This book offers readers an overview of the state-of-the-art and emerging themes in affective computing, including a comprehensive review of the existing approaches to affective computing systems and social signal processing. It provides in-depth case studies of applied affective computing in various domains, such as social robotics and mental well-being. It also addresses ethical concerns related to affective computing and how to prevent misuse of the technology in research and applications. Further, this book identifies future directions for the field and summarizes a set of guidelines for developing next-generation affective computing systems that are effective, safe, and human-centered. For researchers and practitioners new to affective computing, this book will serve as an introduction to the field to help them in identifying new research topics or developing novel applications. For more experienced researchers and practitioners, the discussions in this book provide guidance for adopting a human-centered design and development approach to advance affective computing.

Affective computing refers to computing that relates to, arises from, or influences emotions, as pioneered by Rosalind Picard in 1995. The goal of affective computing is to bridge the gap between human and machines and ultimately enable robots to communicate with human naturally and emotionally. Recently, the research on affective computing has gained considerable progress with many fields contributing including neuroscience, psychology, education, medicine, behavior, sociology, and computer science. Current research in affective computing mainly focuses on estimating of human emotions through different forms of signals, e.g., face video, EEG, Speech, PET scans or fMRI. Inferring the emotion of humans is difficult, as emotion is a subjective, unconscious experience characterized primarily by psycho-physiological expressions and biological reactions. It is influenced by hormones and neurotransmitters such as dopamine, noradrenaline, serotonin, oxytocin, GABA… etc. The physiology of emotion is closely linked to arousal of the nervous system with various states and strengths relating, apparently, to different particular emotions. To understand “emotion” or “affect” merely by machine learning or big data analysis is not enough, but the understanding and applications from the intrinsic features of emotions from the neuroscience aspect is essential.

Recent advances in socio-cognitive and affective computing require further study as countless benefits and opportunities have emerged from these innovative technologies that may be useful in a number of contexts throughout daily life. In order to ensure these technologies are appropriately utilized across sectors, the challenges and strategies for adoption as well as potential uses must be thoroughly considered. Principles and Applications of Socio-Cognitive and Affective Computing discusses several aspects of affective interactions and concepts in affective computing, the fundamentals of emotions, and emerging research and exciting techniques for bridging the emotional disparity between humans and machines, all within the context of interactions. The book also considers problem and solution guidelines emerging in cognitive computing, thus summarizing the roadmap of current machine computational intelligence techniques for affective computing. Covering a range of topics such as social interaction, robotics, and virtual reality, this reference work is crucial for scientists, engineers, industry professionals, academicians, researchers, scholars, practitioners, instructors, and students.

This book addresses and disseminates research and development in the applications of intelligent techniques for computer vision, the field that works on enabling computers to see, identify, and process images in the same way that human vision does, and then providing appropriate output. The book provides contributions which include theory, case studies, and intelligent techniques pertaining to computer vision applications. The book helps readers grasp the essence of the recent advances in this complex field. The audience includes researchers, professionals, practitioners, and students from academia and industry who work in this interdisciplinary field. The authors aim to inspire future research both from theoretical and practical viewpoints to spur further advances in the field.

Computer understanding of human emotions has become crucial and complex within the era of digital interaction and artificial intelligence. Emotion detection, a field within AI, holds promise for enhancing user experiences, personalizing services, and revolutionizing industries. However, navigating this landscape requires a deep understanding of machine and deep learning techniques and the interdisciplinary challenges accompanying them. Machine and Deep Learning Techniques for Emotion Detection offer a comprehensive solution to this pressing problem. Designed for academic scholars, practitioners, and students, it is a guiding light through the intricate terrain of emotion detection. By blending theoretical insights with practical implementations and real-world case studies, our book equips readers with the knowledge and tools needed to advance the frontier of emotion analysis using machine and deep learning methodologies.

Markus Kächele offers a detailed view on the different steps in the affective computing pipeline, ranging from corpus design and recording over annotation and feature extraction to post-processing, classification of individual modalities and fusion in the context of ensemble classifiers. He focuses on multimodal recognition of discrete and continuous emotional and medical states. As such, specifically the peculiarities that arise during annotation and processing of continuous signals are highlighted. Furthermore, methods are presented that allow personalization of datasets and adaptation of classifiers to new situations and persons.

Affective Computing is a growing multidisciplinary field encompassing computer science, engineering, psychology, education, neuroscience, and many other disciplines. It explores how affective factors influence interactions between humans and technology, how affect sensing and affect generation techniques can inform our understanding of human affect, and on the design, implementation, and evaluation of systems that intricately involve affect at their core. The Oxford Handbook of Affective Computing will help both new and experienced researchers identify trends, concepts, methodologies, and applications in this burgeouning field. The volume features 41 chapters divided into five main sections: history and theory, detection, generation, methodologies, and applications. Section One begins with a look at the makings of AC and a historical review of the science of emotion. Chapters discuss the theoretical underpinnings of AC from an interdisciplinary perspective involving the affective, cognitive, social, media, and brain sciences. Section Two focuses on affect detection or affect recognition, which is one of the most commonly investigated areas in AC. Section Three examines aspects of affect generation including the synthesis of emotion and its expression via facial features, speech, postures and gestures. Cultural issues in affect generation are also discussed. Section Four features chapters on methodological issues in AC research, including data collection techniques, multimodal affect databases, emotion representation formats, crowdsourcing techniques, machine learning approaches, affect elicitation techniques, useful AC tools, and ethical issues in AC. Finally, Section Five highlights existing and future applications of AC in domains such as formal and informal learning, games, robotics, virtual reality, autism research, healthcare, cyberpsychology, music, deception, reflective writing, and cyberpsychology. With chapters authored by world leaders in each area, The Oxford Handbook of Affective Computing is suitable for use as a textbook in undergraduate or graduate courses in AC, and will serve as a valuable resource for students, researchers, and practitioners across the globe.