Multimodality Studies In International Contexts

This collection responds to the need for theoretically informed and methodologically grounded empirical research on the global transformations in multimodal human communication and social practices in light of recent widespread change. The volume highlights the need to expand on the established approaches--Social Semiotics, Multimodal Discourse Analysis, and Multimodal (Inter)action Analysis--by complementing them with other analytical frameworks to better understand the impact of unprecedented global challenges, such as Covid-19, on the way humans communicate and make use of meaning-making resources. Bringing together established and emergent scholars from a variety of geographical, cultural, and linguistic contexts, the collection presents studies from both the Global North and Global South, including South Africa, Latin America, Brazil, and the Caribbean, to showcase new perspectives in multimodality research. This innovative book will be of interest to students and scholars in multimodality, social semiotics, and discourse analysis.

"This collection responds to the need for theoretically informed and methodologically grounded empirical research on the global transformations in multimodal human communication and social practices in light of recent widespread change. The volume highlights the need to expand on the established approaches--Social Semiotics, Multimodal Discourse Analysis, and Multimodal (Inter)action Analysis--by complementing them with other analytical frameworks to better understand the impact of unprecedented global challenges, such as Covid-19, on the way humans communicate and make use of meaning-making resources. Bringing together established and emergent scholars from a variety of geographical, cultural, and linguistic contexts, the collection presents studies from both the Global North and Global South, including South Africa, Latin America, Brazil, and the Caribbean, to showcase new perspectives in multimodality research. This innovative book will be of interest to students and scholars in multimodality, social semiotics, and discourse analysis"--

This collection critically considers the question of how learning and teaching should be conceived, understood, and approached in light of the changing nature of learning scenarios and new pedagogies in this current age of multimodal digital texts, practices, and communities. The book takes the concept of digital artifacts as being composed of multiple meaning-making semiotic resources, such as visuals, music, and design, as its point of departure to explore how diverse communities interact with these tools and develop and explore their understanding of digital practices in learning contexts. The first section of the volume examines different case studies in which involved participants learn to grapple with the introduction of digital tools for learning in children’s early years of schooling. The second section extends the focus to secondary and higher education settings as digital learning tools grow more complex as do students, parents, and teachers’ interactions with them and the subsequent need for new pedagogies to rethink these multimodal artifacts. A final section reflects on the implications of new multimodal tools, technologies, and pedagogies for teachers, such as on teacher training and community building among educators. In its in-depth look at multimodal approaches to learning as meaning-making in a digital world, this book will be of interest to students and scholars in multimodality, English language teaching, digital communication, and education.

This volume advances the data-based study of multimodal artefacts and performances by showcasing methods and results from the latest endeavors in empirical multimodal research, representing a vibrant international and interdisciplinary research community. The collated chapters identify and seek to inspire novel, mixed-method approaches to investigate meaning-making mechanisms in current communicative artifacts, designs, and contexts; while attending to their immersive, aesthetic, and ideological dimensions. Each contribution details innovative aspects of empirical multimodality research, offering insights into challenges evolving from quantitative approaches, particular corpus work, results from eye-tracking and psychological experiments, and analyses of dynamic interactive experiences. The approaches and results presented foreground the inherent multidisciplinary nature and implications of multimodality, renegotiating concepts across linguistics, media studies, (social) semiotics, game studies, and design. With this, the volume will inform both current and future developments in theory, methods, and transdisciplinary contexts and become a landmark reference for anyone interested in the empirical study of multimodality.

This volume presents innovative research on the multimodal dimension of discourse specific to academic settings, with a particular focus on the interaction between the verbal and non-verbal in constructing meaning. Contributions by experienced and emerging researchers provide in-depth analyses in both research and teaching contexts, and consider the ways in which multimodal strategies can be leveraged to enhance the effectiveness of academic communication. Contributors employ both quantitative and qualitative analytical methods, and make use of state-of-the-art software for analyzing multimodal features of discourse. The chapters in the first part of the volume focus on the multimodal features of two key research genres: conference presentations and plenary addresses. In the second part, contributors explore the role of multimodality in the classroom through analyses of both instructors’ and students’ speech, as well as the use of multimodal materials for more effective learning. The research presented in this volume is particularly relevant within the context of globalized higher education, where participants represent a wide range of linguistic and cultural backgrounds. Multimodal Analysis in Academic Settings contributes to an emerging field of research with importance to an increasing number of academics and practitioners worldwide.

Contemporary society has witnessed radical changes in the field of communications in terms of how messages and meanings are disseminated. Digitalization and the Internet have signalled an exponential rise in the circulation of multimodal texts in which different semiotic resources are orchestrated together to construct meaning in all areas of social life, across languages and cultures, and in diverse specialized discourse domains. This has foregrounded the need to examine the semiotic functions, affordances, and issues at stake in a range of multimodal discourse forms, while simultaneously highlighting the importance of critical multimodal literacy in audiences and learners. This volume develops and extends pioneering research on the intersection between multimodality and specialized discourse. Eight newly commissioned studies offer innovative perspectives on multimodal research methodologies and applications in a variety of ESP (English for Specific Purposes) contexts for practitioners and scholars alike. The volume offers a glimpse at future directions in this dynamic and ever-evolving area of investigation focusing on the synergy between verbal and non-verbal modes of communication in the digital age. Each chapter explores an original area of application: academic, economic, scientific, marketing, legal, medical, political, and tourism. The contributors approach multimodality from a range of theoretical and methodological viewpoints including synchronic and diachronic corpus-based and corpus-aided studies, critical discourse analysis, and systemic functional linguistics. Analytical tools such as multimodal (critical) discourse analysis, multimodal transcription, and multimodal annotation software capable of representing the interplay of different semiotic modes - speech, intonation, direction of gaze, facial expressions, gesturing, and spatial positioning of interlocutors - are employed. The diversity of research strands contained in the volume illustrates just some of the vast areas of multimodal knowledge dissemination that are still unmapped. As a cornerstone of communication, multimodality needs exploring in all its facets. These contributions aim to further that cause.

A first in multimodal/multisemiotic discourse studies this collection of original articles by international scholars focuses primarily on texts from non-English speaking contexts. The illuminating insights enhance our understanding of how language and other semiotic resources construe specific cultural and social concerns.

This collection highlights diverse epistemological perspectives in original research on the important role of multimodality in second language contexts. The volume explores a wide range of theoretical and methodological traditions toward foregrounding the notion that bodily action is not merely an add-on to the modality of talk but an integral part of second language teaching, learning, and interaction. Following an introductory chapter, 18 empirical chapters feature either classroom or non-classroom research, which shed light on different dimensions of multimodality in second language contexts, including learning reflected in gesture, learning gesture across languages, the role of bodily action in language teaching, and the role of movement in configuring space for effective communication. Each empirical chapter follows a consistent structure detailing the research focus, the background to each study, methodology, and findings. A concluding synthesis chapter braids the insights of these chapters, drawing parallels across different methods, and pointing toward crosscutting areas for future research. This book will be of interest to students and scholars in applied linguistics, multilingualism, bilingualism, gesture studies, cognitive science, and psychology. Chapter 10 of this book is available for free in PDF format as Open Access at www.taylorfrancis.com. It has been made available under a Creative Commons Attribution-NonCommercial-ShareAlike (CC-BY-NC-SA) 4.0 International license.