The Perceptual Structure Of Sound

This book presents a comprehensive review of how acoustic waves are processed by the auditory system into structured sounds such as musical melodies, speech utterances, or environmental sounds. After an introduction, an overview is given of how the ears distribute acoustic information over a large array of frequency channels that contain the auditory information used by the central nervous system to generate a mental image of what is happening around the listener. This process, called auditory scene analysis, consists of two stages. In the first stage, auditory units are formed such as musical tones and speech syllables. Each auditory unit is perceived at a well-defined moment in time, the beat location of that auditory unit. Moreover, from this process of auditory-unit formation, the auditory attributes of these auditory units emerge, such as their timbre, their pitch, their loudness, and their perceived location. Each of these attributes is discussed in the corresponding chapter. In the second stage of auditory scene analysis, auditory-stream formation, the successive auditory units are integrated into auditory streams, i.e., temporally structured sequences of auditory units that are perceived as emanating from one and the same sound source. Examples of such auditory streams are musical melodies and the utterances of one speaker. The temporal structure of an auditory stream, its rhythm, is determined by the beat locations of its auditory units. The role played by the auditory attributes of the consecutive auditory units is discussed. The melodies of musical streams and the intonation contours of spoken utterances emerge from this process. In music, the beats of parallel streams generally fit into a metric pattern, and, depending on harmony, simultaneous tones can be perceived as consonant or dissonant. Finally, the book contains many sound examples including the MATLAB scripts with which they are generated.

This book presents a comprehensive review of how acoustic waves are processed by the auditory system into structured sounds such as musical melodies, speech utterances, or environmental sounds. After an introduction, an overview is given of how the ears distribute acoustic information over a large array of frequency channels that contain the auditory information used by the central nervous system to generate a mental image of what is happening around the listener. This process, called auditory scene analysis, consists of two stages. In the first stage, auditory units are formed such as musical tones and speech syllables. Each auditory unit is perceived at a well-defined moment in time, the beat location of that auditory unit. Moreover, from this process of auditory-unit formation, the auditory attributes of these auditory units emerge, such as their timbre, their pitch, their loudness, and their perceived location. Each of these attributes is discussed in the corresponding chapter. In the second stage of auditory scene analysis, auditory-stream formation, the successive auditory units are integrated into auditory streams, i.e., temporally structured sequences of auditory units that are perceived as emanating from one and the same sound source. Examples of such auditory streams are musical melodies and the utterances of one speaker. The temporal structure of an auditory stream, its rhythm, is determined by the beat locations of its auditory units. The role played by the auditory attributes of the consecutive auditory units is discussed. The melodies of musical streams and the intonation contours of spoken utterances emerge from this process. In music, the beats of parallel streams generally fit into a metric pattern, and, depending on harmony, simultaneous tones can be perceived as consonant or dissonant. Finally, the book contains many sound examples including the MATLAB scripts with which they are generated.

Auditory Scene Analysis addresses the problem of hearing complex auditory environments, using a series of creative analogies to describe the process required of the human auditory system as it analyzes mixtures of sounds to recover descriptions of individual sounds. In a unified and comprehensive way, Bregman establishes a theoretical framework that integrates his findings with an unusually wide range of previous research in psychoacoustics, speech perception, music theory and composition, and computer modeling.

Roughly defined as any property other than pitch, duration, and loudness that allows two sounds to be distinguished, timbre is a foundational aspect of hearing. The remarkable ability of humans to recognize sound sources and events (e.g., glass breaking, a friend’s voice, a tone from a piano) stems primarily from a capacity to perceive and process differences in the timbre of sounds. Timbre raises many important issues in psychology and the cognitive sciences, musical acoustics, speech processing, medical engineering, and artificial intelligence. Current research on timbre perception unfolds along three main fronts: On the one hand, researchers explore the principal perceptual processes that orchestrate timbre processing, such as the structure of its perceptual representation, sound categorization and recognition, memory for timbre, and its ability to elicit rich semantic associations, as well as the underlying neural mechanisms. On the other hand, timbre is studied as part of specific scenarios, including the perception of the human voice, as a structuring force in music, as perceived with cochlear implants, and through its role in affecting sound quality and sound design. Finally, computational acoustic models are sought through prediction of psychophysical data, physiologically inspired representations, and audio analysis-synthesis techniques. Along these three scientific fronts, significant breakthroughs have been achieved during the last decade. This volume will be the first book dedicated to a comprehensive and authoritative presentation of timbre perception and cognition research and the acoustic modeling of timbre. The volume will serve as a natural complement to the SHAR volumes on the basic auditory parameters of Pitch edited by Plack, Oxenham, Popper, and Fay, and Loudness by Florentine, Popper, and Fay. Moreover, through the integration of complementary scientific methods ranging from signal processing to brain imaging, the book has the potential to leverage new interdisciplinary synergies in hearing science. For these reasons, the volume will be exceptionally valuable to various subfields of hearing science, including cognitive auditory neuroscience, psychoacoustics, music perception and cognition, but may even exert significant influence on fields such as musical acoustics, music information retrieval, and acoustic signal processing. It is expected that the volume will have broad appeal to psychologists, neuroscientists, and acousticians involved in research on auditory perception and cognition. Specifically, this book will have a strong impact on hearing researchers with interest in timbre and will serve as the key publication and up-to-date reference on timbre for graduate students, postdoctoral researchers, as well as established scholars.

Millions of Americans experience some degree of hearing loss. The Social Security Administration (SSA) operates programs that provide cash disability benefits to people with permanent impairments like hearing loss, if they can show that their impairments meet stringent SSA criteria and their earnings are below an SSA threshold. The National Research Council convened an expert committee at the request of the SSA to study the issues related to disability determination for people with hearing loss. This volume is the product of that study. Hearing Loss: Determining Eligibility for Social Security Benefits reviews current knowledge about hearing loss and its measurement and treatment, and provides an evaluation of the strengths and weaknesses of the current processes and criteria. It recommends changes to strengthen the disability determination process and ensure its reliability and fairness. The book addresses criteria for selection of pure tone and speech tests, guidelines for test administration, testing of hearing in noise, special issues related to testing children, and the difficulty of predicting work capacity from clinical hearing test results. It should be useful to audiologists, otolaryngologists, disability advocates, and others who are concerned with people who have hearing loss.

This book contains a complete and accurate mathematical treatment of the sounds of music with an emphasis on musical timbre. The book spans the range from tutorial introduction to advanced research and application to speculative assessment of its various techniques. All the contributors use a generalized additive sine wave model for describing musical timbre which gives a conceptual unity, but is of sufficient utility to be adapted to many different tasks.

Plomp's Aspects of Tone Sensation--published 25 years ago--dealt with the psychophysics of simple and complex tones. Since that time, auditory perception as a field of study has undergone a radical metamorphosis. Technical and methodological innovations, as well as a considerable increase in attention to the various aspects of auditory experience, have changed the picture profoundly. This book is an attempt to account for this development by giving a comprehensive survey of the present state of the art as a whole. Perceptual aspects of hearing, particularly of understanding speech as the main auditory input signal, are thoroughly reviewed.