Body Sound And Space In Music And Beyond Multimodal Explorations

Body and space refer to vital and interrelated dimensions in the experience of sounds and music. Sounds have an overwhelming impact on feelings of bodily presence and inform us about the space we experience. Even in situations where visual information is artificial or blurred, such as in virtual environments or certain genres of film and computer games, sounds may shape our perceptions and lead to surprising new experiences. This book discusses recent developments in a range of interdisciplinary fields, taking into account the rapidly changing ways of experiencing sounds and music, the consequences for how we engage with sonic events in daily life and the technological advancements that offer insights into state-of-the-art methods and future perspectives. Topics range from the pleasures of being locked into the beat of the music, perception–action coupling and bodily resonance, and affordances of musical instruments, to neural processing and cross-modal experiences of space and pitch. Applications of these findings are discussed for movement sonification, room acoustics, networked performance, and for the spatial coordination of movements in dance, computer gaming and interactive artistic installations.

Body and space refer to vital and interrelated dimensions in the experience of sounds and music. Sounds have an overwhelming impact on feelings of bodily presence and inform us about the space we experience. Even in situations where visual information is artificial or blurred, such as in virtual environments or certain genres of film and computer games, sounds may shape our perceptions and lead to surprising new experiences. This book discusses recent developments in a range of interdisciplinary fields, taking into account the rapidly changing ways of experiencing sounds and music, the consequences for how we engage with sonic events in daily life and the technological advancements that offer insights into state-of-the-art methods and future perspectives. Topics range from the pleasures of being locked into the beat of the music, perception–action coupling and bodily resonance, and affordances of musical instruments, to neural processing and cross-modal experiences of space and pitch. Applications of these findings are discussed for movement sonification, room acoustics, networked performance, and for the spatial coordination of movements in dance, computer gaming and interactive artistic installations.

This book explores the contributions of psychological, neuroscientific and philosophical perspectives to the design of contemporary cities. Pursuing an innovative and multidisciplinary approach, it addresses the need to re-launch knowledge and creativity as major cultural and institutional bases of human communities. Dwelling is a form of knowledge and re-invention of reality that involves both the tangible dimension of physical places and their mental representation. Findings in the neuroscientific field are increasingly opening stimulating perspectives on the design of spaces, and highlight how our ability to understand other people is strongly related to our corporeity. The first part of the book focuses on the contributions of various disciplines that deal with the spatial dimension, and explores the dovetailing roles that science and art can play from a multidisciplinary perspective. In turn, the second part formulates proposals on how to promote greater integration between the aesthetic and cultural dimension in spatial design. Given its scope, the book will benefit all scholars, academics and practitioners who are involved in the process of planning, designing and building places, and will foster an international exchange of research, case studies, and theoretical reflections to confront the challenges of designing conscious places and enable the development of communities.

This innovative work introduces the interdisciplinary field of research of kinesemiotics, offering a new adaptable model and means of analysis for understanding forms of movement-based communication, such as dance, that use a codified language shared by a community of users. It begins with a theoretical overview and review of existing literature on the main approaches to movement-based communication, specifically dance, which underpin kinesemiotics as an area of study. It reaffirms previous work which established dance as a form of embodied communication in that it encompasses a wide range of semiotic styles and forms shared by communities of "speakers." In collaboration with the English National Ballet, Maiorani employs the genre of ballet as a means through which to understand and analyse some of the key concepts of kinesemiotics, mainly that of space as a semiotic dimension and "motivated movement," or movement with meaning. Supported by automated movement recognition tools from the fields of bio-robotics engineering and computer science, Maiorani argues for ballet’s capacity, when movements are projected into meaningful space, to extend beyond sequences of physical movements to become a meaning making practice. Kinesemiotics advances interdisciplinary research in the fields of social semiotics, media and communication, multimodality, linguistics, and performance studies and will be of particular interest to students and scholars in these areas.

About the publication Embodiment and the Arts: Views from South Africa presents a diversity of views on the nature and status of the body in relation to acting, advertisements, designs, films, installations, music, photographs, performance, typography, and video works. Applying the methodologies of phenomenology, hermeneutic phenomenology, embodied perception, ecological psychology, and sense-based research, the authors place the body at the centre of their analyses. The cornerstone of the research presented here is the view that aesthetic experience is active and engaged rather than passive and disinterested. This novel volume offers a rich and diverse range of applications of the paradigm of embodiment to the arts in South Africa. Table of Contents List of figures List of tables Acknowledgments Notes on contributors PART 1 Conceptualising embodiment and the arts Chapter 1 Embodiment and the arts in context Jenni Lauwrens 1 Plotting a course 2 Embodiment 3 Aesthetic embodiment 4 The sensorium 5 Too deep for words? 6 Overview of chapters Chapter 2 Enactive cognition in improvising musical ensembles: A South African perspective Marc Duby 1 Introduction 2 The promise of embodied cognition 3 4E cognition: A brief overview 4 Musicking and enactive cognition 5 Conclusion PART 2: Sensory scholarship Chapter 3 Sight/site-specific recording: Embodiment and absence Marc Röntsch 1 Introduction 2 Background 3 Embodiment and artistic research 4 Jazz ensemble playing 5 Blinding 6 On absence 7 Conclusion Chapter 4 The art of touch in remote online environments Jenni Lauwrens 1 Introduction 2 The significance and boundaries of touch 3 Out of touch 4 Holding hands over the internet: Telepresence, co-presence and the promise of digital touch 5 Chasing the Holy Grail of touch 6 Haptic visuality and the memory of touch 7 Conclusion Chapter 5 Outer space and sensory deprivation (or why is outer space so bland?) Amanda du Preez 1 Introduction 2 On blandness 3 What does outer space smell, taste and look like? 4 Falling down or falling up? 5 Gravity mimicked 6 Unfolding within the fourfold 7 Conclusion Chapter 6 The typographic sensorium: A cross-modal reading of letterforms Kyle Rath 1 Introduction: Function(s) of type 2 Design and the typographic sensorium 2.1 Sight: Type as image 2.2 Touch: Type as haptic and kinaesthetic 2.3 Sound: Type as wave-form 2.4 Olfaction: Type as scent and taste 3 Conclusion PART 3: Material presence Chapter 7 A haptic and humanising reading of the subjects of studio portraits and asylum photography in colonial South Africa Rory du Plessis 1 Introduction 2 The Black Photo Album 3 Interpreting photographs from the Orange Free State Asylum, c 1900 3.1 First encounter 3.2 Second encounter 4 Conclusion Chapter 8 Athi-Patra Ruga’s politics of disorientation: Queer(y)ing threads Adéle Adendorff 1 Introduction 2 Spinning tales and fashioning avatars 3 The politics of disorientation 3.1 Queer(y)ing phenomenology 3.2 Miss Congo and the table in the drawing-room 4 Casting off: Tying up loose threads Chapter 9 Seeing an image at the University of Pretoria’s Africana collection in context Sikho Siyotula 1 Introduction 2 The grass at the University of Pretoria’s gates 3 The world visualised in Ethnic map of Southern Africa 4 Visualising the Nguni estate or Shakan period 5 Visualising the Mapungubwe and Zimbabwe estate 6 Conclusion PART 4: Embodied performance and composition Chapter 10 Navigating dissonance: Bodymind and character congruency in acting Èmil Haarhoff, Marth Munro and Marié-Heleen Coetzee 1 Introduction 2 Bodymind and embodiment 3 Acting as an embodied craft 4 Actor-character dissonance and heightened awareness 5 Navigating actor-character dissonance 5.1 Choice and reappraisal 5.2 Actively applying heightened bodymind awareness 6 Conclusion Chapter 11 Advocating the importance of nonverbal communication in multimodal actor training Elri Wium and Janine Lewis 1 Introduction 2 Case control study 3 Nonverbal communication as an analysis model 4 Discussion of syncretic behavioural communication design 5 Data collection and analysis through a mixed-methods approach 5.1 Observation study 5.2 Analysis of habitual characterisation (coded narrative recordings) 5.3 Assessing the semi-structured interviews 6 Conclusion Chapter 12 Embodied composition ontologies, process and technology: Gesture heuristics and creative potential in music Miles Warrington 1 Introduction 2 Creative spaces 3 Compositional approaches, processes and models 3.1 Gesture schemas and embodiment of sound 3.2 Gesture signification 3.3 Problem solving and gesture models 3.4 Hyperinstruments 4 Conclusion Index

Music videos promote popular artists in cultural forms that circulate widely across social media networks. With the advent of YouTube in 2005 and the proliferation of handheld technologies and social networking sites, the music video has become available to millions worldwide, and continues to serve as a fertile platform for the debate of issues and themes in popular culture. This volume of essays serves as a foundational handbook for the study and interpretation of the popular music video, with the specific aim of examining the industry contexts, cultural concepts, and aesthetic materials that videos rely upon in order to be both intelligible and meaningful. Easily accessible to viewers in everyday life, music videos offer profound cultural interventions and negotiations while traversing a range of media forms. From a variety of unique perspectives, the contributors to this volume undertake discussions that open up new avenues for exploring the creative changes and developments in music video production. With chapters that address music video authorship, distribution, cultural representations, mediations, aesthetics, and discourses, this study signals a major initiative to provide a deeper understanding of the intersecting and interdisciplinary approaches that are invoked in the analysis of this popular and influential musical form.

This book presents a comprehensive review of how acoustic waves are processed by the auditory system into structured sounds such as musical melodies, speech utterances, or environmental sounds. After an introduction, an overview is given of how the ears distribute acoustic information over a large array of frequency channels that contain the auditory information used by the central nervous system to generate a mental image of what is happening around the listener. This process, called auditory scene analysis, consists of two stages. In the first stage, auditory units are formed such as musical tones and speech syllables. Each auditory unit is perceived at a well-defined moment in time, the beat location of that auditory unit. Moreover, from this process of auditory-unit formation, the auditory attributes of these auditory units emerge, such as their timbre, their pitch, their loudness, and their perceived location. Each of these attributes is discussed in the corresponding chapter. In the second stage of auditory scene analysis, auditory-stream formation, the successive auditory units are integrated into auditory streams, i.e., temporally structured sequences of auditory units that are perceived as emanating from one and the same sound source. Examples of such auditory streams are musical melodies and the utterances of one speaker. The temporal structure of an auditory stream, its rhythm, is determined by the beat locations of its auditory units. The role played by the auditory attributes of the consecutive auditory units is discussed. The melodies of musical streams and the intonation contours of spoken utterances emerge from this process. In music, the beats of parallel streams generally fit into a metric pattern, and, depending on harmony, simultaneous tones can be perceived as consonant or dissonant. Finally, the book contains many sound examples including the MATLAB scripts with which they are generated.

Whether social, cultural, or individual, the act of imagination always derives from a pre-existing context. For example, we can conjure an alien's scream from previously heard wildlife recordings or mentally rehearse a piece of music while waiting for a train. This process is no less true forthe role of imagination in sonic events and artifacts. Many existing works on sonic imagination tend to discuss musical imagination through terms like compositional creativity or performance technique. In this two-volume Handbook, contributors address this tendency head-on, correcting the currentbias towards visual imagination to instead highlight the many forms of sonic and musical imagination. Topics covered include auditory imagery and the neurology of sonic imagination; aural hallucination and illusion; use of metaphor in the recording studio; the projection of acoustic imagination inarchitectural design; and the design of sound artifacts for cinema and computer games.