Maximum Entropy And Bayesian Methods

Cambridge, England, 1988

The MaxEnt workshops are devoted to Bayesian inference and maximum entropy methods in science and engineering. In addition, this workshop included all aspects of probabilistic inference, such as foundations, techniques, algorithms, and applications. All papers have been peer-reviewed.

This collection of papers by leading researchers in their respective fields contains contributions showing the use of the maximum entropy method in many of the fields in which it finds application. In the physical, mathematical and biological sciences it is often necessary to make inferences based on insufficient data. The problem of choosing one among the many possible conclusions or models which are compatible with the data may be resolved in a variety of ways. A particularly appealing method is to choose the solution which maximizes entropy in the sense that the conclusion or model honours the observed data but implies no further assumptions not warranted by the data. The maximum entropy principle has been growing in importance and acceptance in many fields, perhaps most notably statistical physics, astronomy, geophysics, signal processing, image analysis and physical chemistry. The papers included in this volume touch on most of the current areas of research activity and application, and will be of interest to research workers in all fields in which the maximum entropy method may be applied.

The Twelfth International Workshop on Maximum Entropy and Bayesian Methods in Sciences and Engineering (MaxEnt 92) was held in Paris, France, at the Centre National de la Recherche Scientifique (CNRS), July 19-24, 1992. It is important to note that, since its creation in 1980 by some of the researchers of the physics department at the Wyoming University in Laramie, this was the second time that it took place in Europe, the first time was in 1988 in Cambridge. The two specificities of MaxEnt workshops are their spontaneous and informal charac ters which give the participants the possibility to discuss easily and to make very fruitful scientific and friendship relations among each others. This year's organizers had fixed two main objectives: i) to have more participants from the European countries, and ii) to give special interest to maximum entropy and Bayesian methods in signal and image processing. We are happy to see that we achieved these objectives: i) we had about 100 participants with more than 50 per cent from the European coun tries, ii) we received many papers in the signal and image processing subjects and we could dedicate a full day of the workshop to the image modelling, restoration and recon struction problems.

The 10th International Workshop on Maximum Entropy and Bayesian Methods, MaxEnt 90, was held in Laramie, Wyoming from 30 July to 3 August 1990. This volume contains the scientific presentations given at that meeting. This series of workshops originated in Laramie in 1981, where the first three of what were to become annual workshops were held. The fourth meeting was held in Calgary. the fifth in Laramie, the sixth and seventh in Seattle, the eighth in Cambridge, England, and the ninth at Hanover, New Hampshire. It is most appropriate that the tenth workshop, occurring in the centennial year of Wyoming's statehood, was once again held in Laramie. The original purpose of these workshops was twofold. The first was to bring together workers from diverse fields of scientific research who individually had been using either some form of the maximum entropy method for treating ill-posed problems or the more general Bayesian analysis, but who, because of the narrow focus that intra-disciplinary work tends to impose upon most of us, might be unaware of progress being made by others using these same techniques in other areas. The second was to introduce to those who were somewhat aware of maximum entropy and Bayesian analysis and wanted to learn more, the foundations, the gestalt, and the power of these analyses. To further the first of these ends, presenters at these workshops have included workers from area. s as varied as astronomy, economics, environmenta.

This volume has its origin in the Fifth, Sixth and Seventh Workshops on and Bayesian Methods in Applied Statistics", held at "Maximum-Entropy the University of Wyoming, August 5-8, 1985, and at Seattle University, August 5-8, 1986, and August 4-7, 1987. It was anticipated that the proceedings of these workshops would be combined, so most of the papers were not collected until after the seventh workshop. Because all of the papers in this volume are on foundations, it is believed that the con tents of this volume will be of lasting interest to the Bayesian community. The workshop was organized to bring together researchers from different fields to critically examine maximum-entropy and Bayesian methods in science and engineering as well as other disciplines. Some of the papers were chosen specifically to kindle interest in new areas that may offer new tools or insight to the reader or to stimulate work on pressing problems that appear to be ideally suited to the maximum-entropy or Bayesian method. A few papers presented at the workshops are not included in these proceedings, but a number of additional papers not presented at the workshop are included. In particular, we are delighted to make available Professor E. T. Jaynes' unpublished Stanford University Microwave Laboratory Report No. 421 "How Does the Brain Do Plausible Reasoning?" (dated August 1957). This is a beautiful, detailed tutorial on the Cox-Polya-Jaynes approach to Bayesian probability theory and the maximum-entropy principle.

The 10th International Workshop on Maximum Entropy and Bayesian Methods, MaxEnt 90, was held in Laramie, Wyoming from 30 July to 3 August 1990. This volume contains the scientific presentations given at that meeting. This series of workshops originated in Laramie in 1981, where the first three of what were to become annual workshops were held. The fourth meeting was held in Calgary. the fifth in Laramie, the sixth and seventh in Seattle, the eighth in Cambridge, England, and the ninth at Hanover, New Hampshire. It is most appropriate that the tenth workshop, occurring in the centennial year of Wyoming's statehood, was once again held in Laramie. The original purpose of these workshops was twofold. The first was to bring together workers from diverse fields of scientific research who individually had been using either some form of the maximum entropy method for treating ill-posed problems or the more general Bayesian analysis, but who, because of the narrow focus that intra-disciplinary work tends to impose upon most of us, might be unaware of progress being made by others using these same techniques in other areas. The second was to introduce to those who were somewhat aware of maximum entropy and Bayesian analysis and wanted to learn more, the foundations, the gestalt, and the power of these analyses. To further the first of these ends, presenters at these workshops have included workers from area. s as varied as astronomy, economics, environmenta.

This excellent volume considers the methods, applications and even the foundations of a key area of theoretical study. Namely, that of Bayesian probability, entropy and information theory in scientific and engineering applications. The material here has come out of the so-called MaxEnt workshops that for more than 25 years have explored the subject. Application areas include, but are not limited to: astronomy, physics, chemistry, biology, earth science, and engineering.