Principles Of Neural Information Theory

In this richly illustrated book, it is shown how Shannon's mathematical theory of information defines absolute limits on neural efficiency; limits which ultimately determine the neuroanatomical microstructure of the eye and brain. Written in an informal style this is an ideal introduction to cutting-edge research in neural information theory.

This book deals with information theory, a new and expanding area of neuroscience which provides a framework for understanding neuronal processing.

Understanding how populations of neurons encode information is the challenge faced by researchers in the field of neural coding. Focusing on the many mysteries and marvels of the mind has prompted a prominent team of experts in the field to put their heads together and fire up a book on the subject. Simply titled Principles of Neural Coding, this b

In this fundamental book the authors devise a framework that describes the working of the brain as a whole. It presents a comprehensive introduction to the principles of Neural Information Processing as well as recent and authoritative research. The books ́ guiding principles are the main purpose of neural activity, namely, to organize behavior to ensure survival, as well as the understanding of the evolutionary genesis of the brain. Among the developed principles and strategies belong self-organization of neural systems, flexibility, the active interpretation of the world by means of construction and prediction as well as their embedding into the world, all of which form the framework of the presented description. Since, in brains, their partial self-organization, the lifelong adaptation and their use of various methods of processing incoming information are all interconnected, the authors have chosen not only neurobiology and evolution theory as a basis for the elaboration of such a framework but also systems and signal theory. The most important message of the book and authors is: brains are evolved as a whole and a description of parts although necessary lets one miss the wood for the trees.

Two distinguished neuroscientists distil general principles from more than a century of scientific study, “reverse engineering” the brain to understand its design. Neuroscience research has exploded, with more than fifty thousand neuroscientists applying increasingly advanced methods. A mountain of new facts and mechanisms has emerged. And yet a principled framework to organize this knowledge has been missing. In this book, Peter Sterling and Simon Laughlin, two leading neuroscientists, strive to fill this gap, outlining a set of organizing principles to explain the whys of neural design that allow the brain to compute so efficiently. Setting out to “reverse engineer” the brain—disassembling it to understand it—Sterling and Laughlin first consider why an animal should need a brain, tracing computational abilities from bacterium to protozoan to worm. They examine bigger brains and the advantages of “anticipatory regulation”; identify constraints on neural design and the need to “nanofy”; and demonstrate the routes to efficiency in an integrated molecular system, phototransduction. They show that the principles of neural design at finer scales and lower levels apply at larger scales and higher levels; describe neural wiring efficiency; and discuss learning as a principle of biological design that includes “save only what is needed.” Sterling and Laughlin avoid speculation about how the brain might work and endeavor to make sense of what is already known. Their distinctive contribution is to gather a coherent set of basic rules and exemplify them across spatial and functional scales.

Understanding how populations of neurons encode information is the challenge faced by researchers in the field of neural coding. Focusing on the many mysteries and marvels of the mind has prompted a prominent team of experts in the field to put their heads together and fire up a book on the subject. Simply titled Principles of Neural Coding, this book covers the complexities of this discipline. It centers on some of the major developments in this area and presents a complete assessment of how neurons in the brain encode information. The book collaborators contribute various chapters that describe results in different systems (visual, auditory, somatosensory perception, etc.) and different species (monkeys, rats, humans, etc). Concentrating on the recording and analysis of the firing of single and multiple neurons, and the analysis and recording of other integrative measures of network activity and network states—such as local field potentials or current source densities—is the basis of the introductory chapters. Provides a comprehensive and interdisciplinary approach Describes topics of interest to a wide range of researchers The book then moves forward with the description of the principles of neural coding for different functions and in different species and concludes with theoretical and modeling works describing how information processing functions are implemented. The text not only contains the most important experimental findings, but gives an overview of the main methodological aspects for studying neural coding. In addition, the book describes alternative approaches based on simulations with neural networks and in silico modeling in this highly interdisciplinary topic. It can serve as an important reference to students and professionals.

Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like ‘20 questions’ before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal style, with a comprehensive glossary and tutorial appendices, this text is an ideal primer for novices who wish to learn the essential principles and applications of information theory.

Neural networks have had considerable success in a variety of disciplines including engineering, control, and financial modelling. However a major weakness is the lack of established procedures for testing mis-specified models and the statistical significance of the various parameters which have been estimated. This is particularly important in the majority of financial applications where the data generating processes are dominantly stochastic and only partially deterministic. Based on the latest, most significant developments in estimation theory, model selection and the theory of mis-specified models, this volume develops neural networks into an advanced financial econometrics tool for non-parametric modelling. It provides the theoretical framework required, and displays the efficient use of neural networks for modelling complex financial phenomena. Unlike most other books in this area, this one treats neural networks as statistical devices for non-linear, non-parametric regression analysis.