Multimodal Communication

This book draws on visual data, ranging from advertisements to postage stamps to digital personal photography, to offer a complex interpretation of the different social functions realised by these texts as semiotic artefacts. Framed within the media environment of the city of Hong Kong, the study demonstrates the importance of social context to meaning making and social semiotic multimodal analysis. This book will be of interest to readers in the arts, humanities and social sciences, particularly within the fields of semiotics, visual studies, design studies, media and cultural studies, anthropology and sociology.

Dance Data, Cognition, and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world. It is a reflection on the observation of bodily movements in artistic settings, and one that views human social interactions, multimodal communication, and cognitive processes through a different lens—that of the close collaboration between performing artists, designers, and scholars. This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones. The book, which includes digital Support Material on the volume's Routledge website, will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, new media, and creativity studies.

This book constitutes the thoroughly refereed post-proceedings of the Second International Conference on Cooperative Multimodal Communication, CMC'98, held in Tilburg, The Netherlands, in January 1998. The 13 revised full papers presented together with an introductory survey by the volume editors have passed through two rounds of reviewing, selection, and revision. The book offers topical sections on multimodal generation, multimodal cooperation, multimodal interpretation, and multimedia platforms and test environments.

This collection brings together a range of perspectives on multimodal communication in intercultural interaction, bridging cognitive, social, and functional approaches towards promoting cross-disciplinary dialogues and taking research at the intersections of these fields into new directions. The volume assembles conversationalist, socially oriented, cognitive, and sensory approaches in considering culture as a dynamic construct, co-constituted and (re)negotiated among participants in interaction and filtering it through a multimodal lens, drawing on a range of examples, such as educational settings or online video platforms. Each chapter offers a unique perspective on "culture" and "intercultural," while also situating their own definitions of these labels against those of the other chapters. Taken together, the chapters form a fluid conversation on the nature of intercultural encounters in today’s globalizsd world, as digital environments intertwine with the physical mobility of people, encouraging researchers across these fields to adopt a more holistic multimodal perspective to approach intercultural interaction. This book will be of interest to students and scholars in intercultural communication, multimodality, sociolinguistics, cognitive and interactional linguistics, and semiotics.

The general focus of this book is on multimodal communication, which captures the temporal patterns of behavior in various dialogue settings. After an overview of current theoretical models of verbal and nonverbal communication cues, it presents studies on a range of related topics: paraverbal behavior patterns in the classroom setting; a proposed optimal methodology for conversational analysis; a study of time and mood at work; an experiment on the dynamics of multimodal interaction from the observer’s perspective; formal cues of uncertainty in conversation; how machines can know we understand them; and detecting topic changes using neural network techniques. A joint work bringing together psychologists, communication scientists, information scientists and linguists, the book will be of interest to those working on a wide range of applications from industry to home, and from health to security, with the main goals of revealing, embedding and implementing a rich spectrum of information on human behavior.

This highly readable book develops a numanistic, and specifically semiotic approach to multiculturalism. It reveals how semiotics provides fresh and valuable insights into multiculturalism: in contrast to the binary logic of dualistic philosophy, semiotic logic does not understand the value of truth in rigid terms of ‘true’ or ‘false’, ‘right’ or ‘wrong’ only. The value of truth resides in meaning, which is a dynamic, evolutionary phenomenon, rooted, nevertheless, in factuality. Drawing on recent developments in biosemiotics, the book presents a theoretical approach to multiculturalism, regarding the lives of people living in multicultural environments. Rather than analyzing political or economic phenomena, it offers a semiotic analysis of multiculturalism and discusses its educational implications. It also invites readers to regard learning as a phenomenon of ecological sign growth and to understand multiculturalism along the same lines. As such, it brings together the life and social sciences and the humanities in a unified perspective, in an approach fitting postmodernism. Developing a postmodern philosophy for contemporary non-experts, which allows distancing from political discourse in favor of a posthumanistic stand, where altruism is seen as an opportunity, not a threat, this book appeals to a wide readership, from scholars seeking state-of-the-art theories to general readers looking for a thought-provoking and enlightening read.

Successful communication requires optimal relevance to a target audience. Relevance theory (RT) provides an excellent model based on this insight, but the impact of the theory has until now been restricted due to an almost exclusive focus on spoken face-to-face communication. Visual and Multimodal Communication: Applying the Relevance Principle is the first book to systematically demonstrate how RT can fulfill its promise to develop into an inclusive theory of communication. In this book, Charles Forceville refines and adapts RT's original claims to show its applicability to static visuals and multimodal discourses in popular culture genres. Using colorful examples, he explains how RT can be expanded and adapted to accommodate mass-communicative visual and visual-plus-verbal messages. Forceville addresses issues such as the difference between drawing prospective addressees' attention to a message and persuading them to accept it; the thorny continuum from implicit to explicit information; and the role of genre. Case studies of pictograms, advertisements, cartoons, and comics provide contemporary and accessible examples of the importance of genre and of how the RT model can be connected to other approaches. By expanding the application of relevance theory to include mass-communicative messages, Visual and Multimodal Communication reintroduces a central framework of cognitive linguistics and pragmatics to a new audience and paves the way for an inclusive theory of communication.

This highly readable book develops a numanistic, and specifically semiotic approach to multiculturalism. It reveals how semiotics provides fresh and valuable insights into multiculturalism: in contrast to the binary logic of dualistic philosophy, semiotic logic does not understand the value of truth in rigid terms of ‘true’ or ‘false’, ‘right’ or ‘wrong’ only. The value of truth resides in meaning, which is a dynamic, evolutionary phenomenon, rooted, nevertheless, in factuality. Drawing on recent developments in biosemiotics, the book presents a theoretical approach to multiculturalism, regarding the lives of people living in multicultural environments. Rather than analyzing political or economic phenomena, it offers a semiotic analysis of multiculturalism and discusses its educational implications. It also invites readers to regard learning as a phenomenon of ecological sign growth and to understand multiculturalism along the same lines. As such, it brings together the life and social sciences and the humanities in a unified perspective, in an approach fitting postmodernism. Developing a postmodern philosophy for contemporary non-experts, which allows distancing from political discourse in favor of a posthumanistic stand, where altruism is seen as an opportunity, not a threat, this book appeals to a wide readership, from scholars seeking state-of-the-art theories to general readers looking for a thought-provoking and enlightening read.