Anticipatory Learning Classifier Systems

Anticipatory Learning Classifier Systems describes the state of the art of anticipatory learning classifier systems-adaptive rule learning systems that autonomously build anticipatory environmental models. An anticipatory model specifies all possible action-effects in an environment with respect to given situations. It can be used to simulate anticipatory adaptive behavior. Anticipatory Learning Classifier Systems highlights how anticipations influence cognitive systems and illustrates the use of anticipations for (1) faster reactivity, (2) adaptive behavior beyond reinforcement learning, (3) attentional mechanisms, (4) simulation of other agents and (5) the implementation of a motivational module. The book focuses on a particular evolutionary model learning mechanism, a combination of a directed specializing mechanism and a genetic generalizing mechanism. Experiments show that anticipatory adaptive behavior can be simulated by exploiting the evolving anticipatory model for even faster model learning, planning applications, and adaptive behavior beyond reinforcement learning. Anticipatory Learning Classifier Systems gives a detailed algorithmic description as well as a program documentation of a C++ implementation of the system.

Learning classi er systems are rule-based systems that exploit evolutionary c- putation and reinforcement learning to solve di cult problems. They were - troduced in 1978 by John H. Holland, the father of genetic algorithms, and since then they have been applied to domains as diverse as autonomous robotics, trading agents, and data mining. At the Second International Workshop on Learning Classi er Systems (IWLCS 99), held July 13, 1999, in Orlando, Florida, active researchers reported on the then current state of learning classi er system research and highlighted some of the most promising research directions. The most interesting contri- tions to the meeting are included in the book Learning Classi er Systems: From Foundations to Applications, published as LNAI 1813 by Springer-Verlag. The following year, the Third International Workshop on Learning Classi er Systems (IWLCS 2000), held September 15{16 in Paris, gave participants the opportunity to discuss further advances in learning classi er systems. We have included in this volume revised and extended versions of thirteen of the papers presented at the workshop.

This book constitutes the thoroughly refereed post-proceedings of the 4th International Workshop on Learning Classifier Systems, IWLCS 2001, held in San Francisco, CA, USA, in July 2001. The 12 revised full papers presented together with a special paper on a formal description of ACS have gone through two rounds of reviewing and improvement. The first part of the book is devoted to theoretical issues of learning classifier systems including the influence of exploration strategy, self-adaptive classifier systems, and the use of classifier systems for social simulation. The second part is devoted to applications in various fields such as data mining, stock trading, and power distributionn networks.

The interdisciplinary topic of anticipation, attracting attention fromnbsp;computer scientists, psychologists, philosophers, neuroscientists, and biologists is a rather new and often misunderstood matter of research. This book attempts to establish anticipation as a research topic and encourage further research and development work. First, the book presents philosophical thoughts and concepts to stimulate the reader's concern about the topic. Fundamental cognitive psychology experiments then confirm the existence of anticipatory behavior in animals and humans and outline a first framework of anticipatory learning and behavior. Next, several distinctions and frameworks of anticipatory processes are discussed, including first implementations of these concepts. Finally, several anticipatory systems and studies on anticipatory behavior are presented.

The 5th International Workshop on Learning Classi?er Systems (IWLCS2002) was held September 7–8, 2002, in Granada, Spain, during the 7th International Conference on Parallel Problem Solving from Nature (PPSN VII). We have included in this volume revised and extended versions of the papers presented at the workshop. In the ?rst paper, Browne introduces a new model of learning classi?er system, iLCS, and tests it on the Wisconsin Breast Cancer classi?cation problem. Dixon et al. present an algorithm for reducing the solutions evolved by the classi?er system XCS, so as to produce a small set of readily understandable rules. Enee and Barbaroux take a close look at Pittsburgh-style classi?er systems, focusing on the multi-agent problem known as El-farol. Holmes and Bilker investigate the effect that various types of missing data have on the classi?cation performance of learning classi?er systems. The two papers by Kovacs deal with an important theoretical issue in learning classi?er systems: the use of accuracy-based ?tness as opposed to the more traditional strength-based ?tness. In the ?rst paper, Kovacs introduces a strength-based version of XCS, called SB-XCS. The original XCS and the new SB-XCS are compared in the second paper, where - vacs discusses the different classes of solutions that XCS and SB-XCS tend to evolve.

Learning Classifier Systems (LCS) are a machine learning paradigm introduced by John Holland in 1976. They are rule-based systems in which learning is viewed as a process of ongoing adaptation to a partially unknown environment through genetic algorithms and temporal difference learning. This book provides a unique survey of the current state of the art of LCS and highlights some of the most promising research directions. The first part presents various views of leading people on what learning classifier systems are. The second part is devoted to advanced topics of current interest, including alternative representations, methods for evaluating rule utility, and extensions to existing classifier system models. The final part is dedicated to promising applications in areas like data mining, medical data analysis, economic trading agents, aircraft maneuvering, and autonomous robotics. An appendix comprising 467 entries provides a comprehensive LCS bibliography.

This accessible introduction shows the reader how to understand, implement, adapt, and apply Learning Classifier Systems (LCSs) to interesting and difficult problems. The text builds an understanding from basic ideas and concepts. The authors first explore learning through environment interaction, and then walk through the components of LCS that form this rule-based evolutionary algorithm. The applicability and adaptability of these methods is highlighted by providing descriptions of common methodological alternatives for different components that are suited to different types of problems from data mining to autonomous robotics. The authors have also paired exercises and a simple educational LCS (eLCS) algorithm (implemented in Python) with this book. It is suitable for courses or self-study by advanced undergraduate and postgraduate students in subjects such as Computer Science, Engineering, Bioinformatics, and Cybernetics, and by researchers, data analysts, and machine learning practitioners.

Anticipatory behavior in adaptive learning systems continues attracting attention of researchers in many areas, including cognitive systems, neuroscience, psychology, and machine learning. This book constitutes the thoroughly refereed post-workshop proceedings of the 4th International Workshop on Anticipatory Behavior in Adaptive Learning Systems, ABiALS 2008, held in Munich, Germany, in June 2008, in collaboration with the six-monthly Meeting of euCognition 'The Role of Anticipation in Cognition'. The 18 revised full papers presented were carefully selected during two rounds of reviewing and improvement for inclusion in the book. The introductory chapter of this state-of-the-art survey not only provides an overview of the contributions included in this volume but also revisits the current available terminology on anticipatory behavior and relates it to the available system approaches. The papers are organized in topical sections on anticipation in psychology with focus on the ideomotor view, conceptualizations, anticipation and dynamical systems, computational modeling of psychological processes in the individual and social domains, behavioral and cognitive capabilities based on anticipation, and computational frameworks and algorithms for anticipation, and their evaluation.