Multimodality In Architecture

This book examines multimodality in architecture and its impacts on collaborative, technical and educational processes or systems. Multimodality is becoming increasingly critical in contemporary architectural practice and education. Creative design teams face new challenges when they embrace new modes of communication, technology, and knowledge development processes. From diverse online modes of communication to shared digital environments, generative AI and advanced hardware solutions, new modes of information creation, sharing, and application are changing the ways architects and designers work. The book presents new research which empowers international researchers and designers to work more effectively in a diverse range of digital environments. Whether the readers are architects, teachers, students, or scholars, this book provides critical insights and practical tools for understanding and optimising processes in architecture and design.

This book provides an extended exploration of the multimodal analysis of spatial (three-dimensional) texts of the built environment, culminating in a holistic approach termed Spatial Discourse Analysis (SpDA). Based on existing frameworks of multimodal analysis, this book applies, adapts, and extends these frameworks to spatial texts. The authors argue that choices in spatial design create meanings about what we perceive and how we can or should behave within spatial texts, influence how we feel in and about those spaces, and enable these texts to function as coherent wholes. Importantly, a spatial text, once built, is also a resource which is then used, and an essential aspect of understanding these texts is to consider what users themselves contribute to the meaning potential of these texts. The book takes the metafunctional approach familiar from Systemic-Functional Linguistics (SFL) and foregrounds each metafunction in turn (textual, interpersonal, experiential, and logical), in relation to the detailed analysis of a particular spatial text.

This book provides an extended exploration of the multimodal analysis of spatial (three-dimensional) texts of the built environment, culminating in a holistic approach termed Spatial Discourse Analysis (SpDA). Based on existing frameworks of multimodal analysis, this book applies, adapts, and extends these frameworks to spatial texts. The authors argue that choices in spatial design create meanings about what we perceive and how we can or should behave within spatial texts, influence how we feel in and about those spaces, and enable these texts to function as coherent wholes. Importantly, a spatial text, once built, is also a resource which is then used, and an essential aspect of understanding these texts is to consider what users themselves contribute to the meaning potential of these texts. The book takes the metafunctional approach familiar from Systemic-Functional Linguistics (SFL) and foregrounds each metafunction in turn (textual, interpersonal, experiential, and logical), in relation to the detailed analysis of a particular spatial text.

During the last decade, cell phones with multimodal interfaces based on combined new media have become the dominant computer interface worldwide. Multimodal interfaces support mobility and expand the expressive power of human input to computers. They have shifted the fulcrum of human-computer interaction much closer to the human. This book explains the foundation of human-centered multimodal interaction and interface design, based on the cognitive and neurosciences, as well as the major benefits of multimodal interfaces for human cognition and performance. It describes the data-intensive methodologies used to envision, prototype, and evaluate new multimodal interfaces. From a system development viewpoint, this book outlines major approaches for multimodal signal processing, fusion, architectures, and techniques for robustly interpreting users' meaning. Multimodal interfaces have been commercialized extensively for field and mobile applications during the last decade. Research also is growing rapidly in areas like multimodal data analytics, affect recognition, accessible interfaces, embedded and robotic interfaces, machine learning and new hybrid processing approaches, and similar topics. The expansion of multimodal interfaces is part of the long-term evolution of more expressively powerful input to computers, a trend that will substantially improve support for human cognition and performance. Table of Contents: Preface: Intended Audience and Teaching with this Book / Acknowledgments / Introduction / Definition and Typre of Multimodal Interface / History of Paradigm Shift from Graphical to Multimodal Interfaces / Aims and Advantages of Multimodal Interfaces / Evolutionary, Neuroscience, and Cognitive Foundations of Multimodal Interfaces / Theoretical Foundations of Multimodal Interfaces / Human-Centered Design of Multimodal Interfaces / Multimodal Signal Processing, Fusion, and Architectures / Multimodal Language, Semantic Processing, and Multimodal Integration / Commercialization of Multimodal Interfaces / Emerging Multimodal Research Areas, and Applications / Beyond Multimodality: Designing More Expressively Powerful Interfaces / Conclusions and Future Directions / Bibliography / Author Biographies

This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.

This volume focuses on the relationship between different modes in the emergence, diffusion, maintenance, and/or challenge of social meanings and institutions. The contributions demonstrate the potential of multimodal approaches to advance the design of rigorous methods of analysis for the study of multimodal communicative practices.

Multimodality in Higher Education showcases new directions in multimodal research and also focuses on teaching multimodal text production and writing pedagogy. It theorizes writing practices and writing pedagogy in Higher Educational contexts from a multimodal perspective.