Social Signal Processing

This book provides comprehensive, authoritative surveys covering the modeling, automatic detection, analysis, and synthesis of nonverbal social signals.

"The Oxford Handbook of Affective Computing is a definitive reference in the burgeoning field of affective computing (AC), a multidisciplinary field encompassing computer science, engineering, psychology, education, neuroscience, and other disciplines. AC research explores how affective factors influence interactions between humans and technology, how affect sensing and affect generation techniques can inform our understanding of human affect, and on the design, implementation, and evaluation of systems involving affect at their core. The volume features 41 chapters and is divided into five sections: history and theory, detection, generation, methodologies, and applications. Section 1 begins with the making of AC and a historical review of the science of emotion. The following chapters discuss the theoretical underpinnings of AC from an interdisciplinary viewpoint. Section 2 examines affect detection or recognition, a commonly investigated area. Section 3 focuses on aspects of affect generation, including the synthesis of emotion and its expression via facial features, speech, postures, and gestures. Cultural issues are also discussed. Section 4 focuses on methodological issues in AC research, including data collection techniques, multimodal affect databases, formats for the representation of emotion, crowdsourcing techniques, machine learning approaches, affect elicitation techniques, useful AC tools, and ethical issues. Finally, Section 5 highlights applications of AC in such domains as formal and informal learning, games, robotics, virtual reality, autism research, health care, cyberpsychology, music, deception, reflective writing, and cyberpsychology. This compendium will prove suitable for use as a textbook and serve as a valuable resource for everyone with an interest in AC."--

Social Signal Processing is the first book to cover all aspects of the modeling, automated detection, analysis, and synthesis of nonverbal behavior in human-human and human-machine interactions. Authoritative surveys address conceptual foundations, machine analysis and synthesis of social signal processing, and applications. Foundational topics include affect perception and interpersonal coordination in communication; later chapters cover technologies for automatic detection and understanding such as computational paralinguistics and facial expression analysis and for the generation of artificial social signals such as social robots and artificial agents. The final section covers a broad spectrum of applications based on social signal processing in healthcare, deception detection, and digital cities, including detection of developmental diseases and analysis of small groups. Each chapter offers a basic introduction to its topic, accessible to students and other newcomers, and then outlines challenges and future perspectives for the benefit of experienced researchers and practitioners in the field.

Cooperative and Graph Signal Processing: Principles and Applications presents the fundamentals of signal processing over networks and the latest advances in graph signal processing. A range of key concepts are clearly explained, including learning, adaptation, optimization, control, inference and machine learning. Building on the principles of these areas, the book then shows how they are relevant to understanding distributed communication, networking and sensing and social networks. Finally, the book shows how the principles are applied to a range of applications, such as Big data, Media and video, Smart grids, Internet of Things, Wireless health and Neuroscience. With this book readers will learn the basics of adaptation and learning in networks, the essentials of detection, estimation and filtering, Bayesian inference in networks, optimization and control, machine learning, signal processing on graphs, signal processing for distributed communication, social networks from the perspective of flow of information, and how to apply signal processing methods in distributed settings. Presents the first book on cooperative signal processing and graph signal processing Provides a range of applications and application areas that are thoroughly covered Includes an editor in chief and associate editor from the IEEE Transactions on Signal Processing and Information Processing over Networks who have recruited top contributors for the book

This unique text/reference provides a coherent and comprehensive overview of all aspects of video analysis of humans. Broad in coverage and accessible in style, the text presents original perspectives collected from preeminent researchers gathered from across the world. In addition to presenting state-of-the-art research, the book reviews the historical origins of the different existing methods, and predicts future trends and challenges. Features: with a Foreword by Professor Larry Davis; contains contributions from an international selection of leading authorities in the field; includes an extensive glossary; discusses the problems associated with detecting and tracking people through camera networks; examines topics related to determining the time-varying 3D pose of a person from video; investigates the representation and recognition of human and vehicular actions; reviews the most important applications of activity recognition, from biometrics and surveillance, to sports and driver assistance.

This book contains papers invited after the First International Workshop on Mobile Social Signal Processing, MSSP 2010, held in Lisbon, Portugal, in September 2010. The 9 revised papers included in this volume represent the diversity of two fields of research, Mobile HCI and Social Signal Processing and areas of overlap. They cover a wide range of topics spanning from approaches for effective interaction with mobile and wearable devices to modelling, analysis and synthesis of nonverbal behaviour in human-human and human-machine interactions.