Pattern Recognition By Self Organizing Neural Networks

Pattern Recognition by Self-Organizing Neural Networks presentsthe most recent advances in an area of research that is becoming vitally important in the fields ofcognitive science, neuroscience, artificial intelligence, and neural networks in general. The 19articles take up developments in competitive learning and computational maps, adaptive resonancetheory, and specialized architectures and biological connections. Introductorysurvey articles provide a framework for understanding the many models involved in various approachesto studying neural networks. These are followed in Part 2 by articles that form the foundation formodels of competitive learning and computational mapping, and recent articles by Kohonen, applyingthem to problems in speech recognition, and by Hecht-Nielsen, applying them to problems in designingadaptive lookup tables. Articles in Part 3 focus on adaptive resonance theory (ART) networks,selforganizing pattern recognition systems whose top-down template feedback signals guarantee theirstable learning in response to arbitrary sequences of input patterns. In Part 4, articles describeembedding ART modules into larger architectures and provide experimental evidence fromneurophysiology, event-related potentials, and psychology that support the prediction that ARTmechanisms exist in the brain. Contributors: J.-P. Banquet, G.A. Carpenter, S.Grossberg, R. Hecht-Nielsen, T. Kohonen, B. Kosko, T.W. Ryan, N.A. Schmajuk, W. Singer, D. Stork, C.von der Malsburg, C.L. Winter.

The human brain, wi th its hundred billion or more neurons, is both one of the most complex systems known to man and one of the most important. The last decade has seen an explosion of experimental research on the brain, but little theory of neural networks beyond the study of electrical properties of membranes and small neural circuits. Nonetheless, a number of workers in Japan, the United States and elsewhere have begun to contribute to a theory which provides techniques of mathematical analysis and computer simulation to explore properties of neural systems containing immense numbers of neurons. Recently, it has been gradually recognized that rather independent studies of the dynamics of pattern recognition, pattern format::ion, motor control, self-organization, etc. , in neural systems do in fact make use of common methods. We find that a "competition and cooperation" type of interaction plays a fundamental role in parallel information processing in the brain. The present volume brings together 23 papers presented at a U. S. -Japan Joint Seminar on "Competition and Cooperation in Neural Nets" which was designed to catalyze better integration of theory and experiment in these areas. It was held in Kyoto, Japan, February 15-19, 1982, under the joint sponsorship of the U. S. National Science Foundation and the Japan Society for the Promotion of Science. Participants included brain theorists, neurophysiologists, mathematicians, computer scientists, and physicists. There are seven papers from the U. S.

The second, revised edition of this book was suggested by the impressive sales of the first edition. Fortunately this enabled us to incorporate new important results that had just been obtained. The ASSOM (Adaptive-Subspace SOM) is a new architecture in which invariant-feature detectors emerge in an unsupervised learning process. Its basic principle was already introduced in the first edition, but the motiva tion and theoretical discussion in the second edition is more thorough and consequent. New material has been added to Sect. 5.9 and this section has been rewritten totally. Correspondingly, Sect. 1.4, which deals with adaptive subspace classifiers in general and constitutes the prerequisite for the ASSOM principle, has also been extended and rewritten totally. Another new SOM development is the WEBSOM, a two-layer architecture intended for the organization of very large collections of full-text documents such as those found in the Internet and World Wide Web. This architecture was published after the first edition came out. The idea and results seemed to be so important that the new Sect. 7.8 has now been added to the second edition. Another addition that contains new results is Sect. 3.15, which describes the acceleration in the computing of very large SOMs. It was also felt that Chap. 7, which deals with 80M applications, had to be extended.

Pattern recognizers evolve across the sections into perceptrons, a layer of perceptrons, multiple-layered perceptrons, functional link nets, and radial basis function networks. Other networks covered in the process are learning vector quantization networks, self-organizing maps, and recursive neural networks. Backpropagation is derived in complete detail for one and two hidden layers for both unipolar and bipolar sigmoid activation functions. The more efficient fullpropagation, quickpropagation, cascade correlation, and various methods such as strategic search, conjugate gradients, and genetic algorithms are described. Advanced methods are also described, including the full-training algorithms for radial basis function networks and random vector functional link nets, as well as competitive learning networks and fuzzy clustering algorithms.

Artificial Neural Networks in Pattern Recognition synthesizes the proceedings of the 4th IAPR TC3 Workshop, ANNPR 2010. Topics include supervised and unsupervised learning, feature selection, pattern recognition in signal and image processing.

In a simple and accessible way it extends embedding field theory into areas of machine intelligence that have not been clearly dealt with before. Neural Networks for Pattern Recognition takes the pioneering work in artificial neural networks by Stephen Grossberg and his colleagues to a new level. In a simple and accessible way it extends embedding field theory into areas of machine intelligence that have not been clearly dealt with before. Following a tutorial of existing neural networks for pattern classification, Nigrin expands on these networks to present fundamentally new architectures that perform realtime pattern classification of embedded and synonymous patterns and that will aid in tasks such as vision, speech recognition, sensor fusion, and constraint satisfaction. Nigrin presents the new architectures in two stages. First he presents a network called Sonnet 1 that already achieves important properties such as the ability to learn and segment continuously varied input patterns in real time, to process patterns in a context sensitive fashion, and to learn new patterns without degrading existing categories. He then removes simplifications inherent in Sonnet 1 and introduces radically new architectures. These architectures have the power to classify patterns that may have similar meanings but that have different external appearances (synonyms). They also have been designed to represent patterns in a distributed fashion, both in short-term and long-term memory.

First of all, we want to congratulate two new research communities from M- ico and Brazil that have recently joined the Iberoamerican community and the International Association for Pattern Recognition. We believe that the series of congresses that started as the “Taller Iberoamericano de Reconocimiento de Patrones (TIARP)”, and later became the “Iberoamerican Congress on Pattern Recognition (CIARP)”, has contributed to these groupconsolidatione?orts. We hope that in the near future all the Iberoamerican countries will have their own groups and associations to promote our areas of interest; and that these congresses will serve as the forum for scienti?c research exchange, sharing of - pertise and new knowledge, and establishing contacts that improve cooperation between research groups in pattern recognition and related areas. CIARP 2004 (9th Iberoamerican Congress on Pattern Recognition) was the ninthinaseriesofpioneeringcongressesonpatternrecognitionintheIberoam- ican community. As in the previous year, CIARP 2004 also included worldwide participation. It took place in Puebla, Mexico. The aim of the congress was to promote and disseminate ongoing research and mathematical methods for pattern recognition, image analysis, and applications in such diverse areas as computer vision, robotics, industry, health, entertainment, space exploration, telecommunications, data mining, document analysis,and natural languagep- cessing and recognition, to name a few.