Photonic Reservoir Computing

Photonics has long been considered an attractive substrate for next generation implementations of machine-learning concepts. Reservoir Computing tremendously facilitated the realization of recurrent neural networks in analogue hardware. This concept exploits the properties of complex nonlinear dynamical systems, giving rise to photonic reservoirs implemented by semiconductor lasers, telecommunication modulators and integrated photonic chips.

This book is the first comprehensive book about reservoir computing (RC). RC is a powerful and broadly applicable computational framework based on recurrent neural networks. Its advantages lie in small training data set requirements, fast training, inherent memory and high flexibility for various hardware implementations. It originated from computational neuroscience and machine learning but has, in recent years, spread dramatically, and has been introduced into a wide variety of fields, including complex systems science, physics, material science, biological science, quantum machine learning, optical communication systems, and robotics. Reviewing the current state of the art and providing a concise guide to the field, this book introduces readers to its basic concepts, theory, techniques, physical implementations and applications. The book is sub-structured into two major parts: theory and physical implementations. Both parts consist of a compilation of chapters, authored by leading experts in their respective fields. The first part is devoted to theoretical developments of RC, extending the framework from the conventional recurrent neural network context to a more general dynamical systems context. With this broadened perspective, RC is not restricted to the area of machine learning but is being connected to a much wider class of systems. The second part of the book focuses on the utilization of physical dynamical systems as reservoirs, a framework referred to as physical reservoir computing. A variety of physical systems and substrates have already been suggested and used for the implementation of reservoir computing. Among these physical systems which cover a wide range of spatial and temporal scales, are mechanical and optical systems, nanomaterials, spintronics, and quantum many body systems. This book offers a valuable resource for researchers (Ph.D. students and experts alike) and practitioners working in the field of machine learning, artificial intelligence, robotics, neuromorphic computing, complex systems, and physics.

This open access book presents an overview of recent advances in photonic neural networks with spatiotemporal dynamics. The computing and implementation paradigms presented in this book are outcomes of interdisciplinary studies by collaborative researchers from the three fields of nonlinear mathematical science, information photonics, and integrated systems engineering. This book offers novel multidisciplinary viewpoints on photonic neural networks, illustrating recent advances in three types of computing methodologies: fluorescence energy transfer computing, spatial-photonic spin system, and photonic reservoir computing. The book consists of four parts: Part I introduces the backgrounds of optical computing and neural network dynamics; Part II presents fluorescence energy transfer computing, a novel computing technology based on nanoscale networks of fluorescent particles; Parts III and IV review the models and implementation of spatial-photonic spin systems and photonic reservoir computing, respectively. These contents are beneficial to researchers in a broad range of fields, including information science, mathematical science, applied physics, and engineering, to better understand the novel computing concepts of photonic neural networks with spatiotemporal dynamics.

This book lies at the interface of machine learning – a subfield of computer science that develops algorithms for challenging tasks such as shape or image recognition, where traditional algorithms fail – and photonics – the physical science of light, which underlies many of the optical communications technologies used in our information society. It provides a thorough introduction to reservoir computing and field-programmable gate arrays (FPGAs). Recently, photonic implementations of reservoir computing (a machine learning algorithm based on artificial neural networks) have made a breakthrough in optical computing possible. In this book, the author pushes the performance of these systems significantly beyond what was achieved before. By interfacing a photonic reservoir computer with a high-speed electronic device (an FPGA), the author successfully interacts with the reservoir computer in real time, allowing him to considerably expand its capabilities and range of possible applications. Furthermore, the author draws on his expertise in machine learning and FPGA programming to make progress on a very different problem, namely the real-time image analysis of optical coherence tomography for atherosclerotic arteries.

This book sets out to build bridges between the domains of photonic device physics and neural networks, providing a comprehensive overview of the emerging field of "neuromorphic photonics." It includes a thorough discussion of evolution of neuromorphic photonics from the advent of fiber-optic neurons to today’s state-of-the-art integrated laser neurons, which are a current focus of international research. Neuromorphic Photonics explores candidate interconnection architectures and devices for integrated neuromorphic networks, along with key functionality such as learning. It is written at a level accessible to graduate students, while also intending to serve as a comprehensive reference for experts in the field.

Neuromorphic Photonic Devices and Applications synthesizes the most critical advances in photonic neuromorphic models, photonic material platforms and accelerators for neuromorphic computing. The book discusses fields and applications that can leverage these new platforms. A brief review of the historical development of the field is followed by a discussion of the emerging 2D photonic materials platforms and recent work in implementing neuromorphic models and 3D neuromorphic systems. The application of artificial intelligence (AI), such as neuromorphic models to inverse design neuromorphic materials and devices and predict performance challenges is discussed throughout. Finally, a comprehensive overview of the applications of neuromorphic photonic technologies and the challenges, opportunities and future prospects is discussed, making the book suitable for researchers and practitioners in academia and R&D in the multidisciplinary field of photonics. Includes overview of primary scientific concepts for the research topic of neuromorphic photonics such as neurons as computational units, artificial intelligence, machine learning and neuromorphic models Reviews the latest advances in photonic materials, device platforms and enabling technology drivers of neuromorphic photonics Discusses potential applications in computing and optical communications

Applications of semiconductor lasers with optical feedback systems are driving rapid developments in theoretical and experimental research. The very broad wavelength-gain-bandwidth of semiconductor lasers combined with frequency-filtered, strong optical feedback create the tunable, single frequency laser systems utilised in telecommunications, environmental sensing, measurement and control. Those with weak to moderate optical feedback lead to the chaotic semiconductor lasers of private communication. This resource illustrates the diversity of dynamic laser states and the technological applications thereof, presenting a timely synthesis of current findings, and providing the roadmap for exploiting their future potential. * Provides theory-based explanations underpinned by a vast range of experimental studies on optical feedback, including conventional, phase conjugate and frequency- filtered feedback in standard, commercial and single-stripe semiconductor lasers * Includes the classic Lang-Kobayashi equation model, through to more recent theory, with new developments in techniques for solving delay differential equations and bifurcation analysis * Explores developments in self-mixing interferometry to produce sub-nanometre sensitivity in path-length measurements * Reviews tunable single frequency semiconductor lasers and systems and their diverse range of applications in sensing and optical communications * Emphasises the importance of synchronised chaotic semiconductor lasers using optical feedback and private communications systems Unlocking Dynamical Diversity illustrates all theory using real world examples gleaned from international cutting-edge research. Such an approach appeals to industry professionals working in semiconductor lasers, laser physics and laser applications and is essential reading for researchers and postgraduates in these fields.

The proceedings set LNCS 11727, 11728, 11729, 11730, and 11731 constitute the proceedings of the 28th International Conference on Artificial Neural Networks, ICANN 2019, held in Munich, Germany, in September 2019. The total of 277 full papers and 43 short papers presented in these proceedings was carefully reviewed and selected from 494 submissions. They were organized in 5 volumes focusing on theoretical neural computation; deep learning; image processing; text and time series; and workshop and special sessions.