Formal Theories Of Information

It is commonly assumed that computers process information. But what is inf- mation? In a technical, important, but nevertheless rather narrow sense, Sh- non’sinformationtheorygivesa?rstanswertothisquestion.Thistheoryfocuses on measuring the information content of a message. Essentially this measure is the reduction of the uncertainty obtained by receiving a message. The unc- tainty of a situation of ignorance in turn is measured by entropy. This theory hashad an immense impact on the technologyof information storage,data c- pression, information transmission and coding and still is a very active domain of research. Shannon’s theory has also attractedmuch interest in a more philosophic look at information, although it was readily remarked that it is only a “syntactic” theory of information and neglects “semantic” issues. Several attempts have been made in philosophy to give information theory a semantic ?avor, but still mostly based on or at least linked to Shannon’s theory. Approaches to semantic informationtheoryalsoveryoftenmakeuseofformallogic.Thereby,information is linked to reasoning, deduction and inference, as well as to decision making. Further, entropy and related measure were soon found to have important connotations with regard to statistical inference. Surely, statistical data and observation represent information, information about unknown, hidden para- ters. Thus a whole branch of statistics developed around concepts of Shannon’s information theory or derived from them. Also some proper measurements - propriate for statistics, like Fisher’s information, were proposed.

This book presents the scientific outcome of a joint effort of the computer science departments of the universities of Berne, Fribourg and Neuchâtel. Within an initiative devoted to "Information and Knowledge", these research groups collaborated over several years on issues of logic, probability, inference, and deduction. The goal of this volume is to examine whether there is any common ground between the different approaches to the concept of information. The structure of this book could be represented by a circular model, with an innermost syntactical circle, comprising statistical and algorithmic approaches; a second, larger circle, the semantical one, in which "meaning" enters the stage; and finally an outermost circle, the pragmatic one, casting light on real-life logical reasoning. These articles are complemented by two philosophical contributions exploring the wide conceptual field as well as taking stock of the articles on the various formal theories of information

This book presents the scientific outcome of a joint effort of the computer science departments of the universities of Berne, Fribourg and Neuchâtel. Within an initiative devoted to "Information and Knowledge", these research groups collaborated over several years on issues of logic, probability, inference, and deduction. The goal of this volume is to examine whether there is any common ground between the different approaches to the concept of information. The structure of this book could be represented by a circular model, with an innermost syntactical circle, comprising statistical and algorithmic approaches; a second, larger circle, the semantical one, in which "meaning" enters the stage; and finally an outermost circle, the pragmatic one, casting light on real-life logical reasoning. These articles are complemented by two philosophical contributions exploring the wide conceptual field as well as taking stock of the articles on the various formal theories of information.

Truth is one of the oldest and most central topics in philosophy. Formal theories explore the connections between truth and logic, and they address truth-theoretic paradoxes such as the Liar. Three leading philosopher-logicians now present a concise overview of the main issues and ideas in formal theories of truth. Beall, Glanzberg, and Ripley explain key logical techniques on which such formal theories rely, providing the formal and logical background needed to develop formal theories of truth. They examine the most important truth-theoretic paradoxes, including the Liar paradoxes. They explore approaches that keep principles of truth simple while relying on nonclassical logic; approaches that preserve classical logic but do so by complicating the principles of truth; and approaches based on substructural logics that change the shape of the target consequence relation itself. Finally, inconsistency and revision theories are reviewed, and contrasted with the approaches previously discussed. For any reader who has a basic grounding in logic, this book offers an ideal guide to formal theories of truth.

This book, first published in 1989, gives a critical account of formal international relations theory. That formal and mathematical methods can be applied to the study of international relations is often regarded with surprise, but the author demonstrates not only how these methods give insights into problems such as deterrence or arms races but also that the increase in the power of explanatory tools depends on the more rigourous development of theory along these lines. Mathematical methods have been applied to the study of international behaviour since the pioneering work of Lewis Fry Richardson in the 1920s and 1930s. However, it was in the post Second World War period that they became widespread. Dr Nicholson discusses the application of such methods as the theory of games to problems of relationships between states, catastrophe theory to the study of initiation of violence, and probability theory to the question of the probability of nuclear war.

Scientific knowledge grows at a phenomenal pace--but few books have had as lasting an impact or played as important a role in our modern world as The Mathematical Theory of Communication, published originally as a paper on communication theory more than fifty years ago. Republished in book form shortly thereafter, it has since gone through four hardcover and sixteen paperback printings. It is a revolutionary work, astounding in its foresight and contemporaneity. The University of Illinois Press is pleased and honored to issue this commemorative reprinting of a classic.

Theories of Probability: An Examination of Foundations reviews the theoretical foundations of probability, with emphasis on concepts that are important for the modeling of random phenomena and the design of information processing systems. Topics covered range from axiomatic comparative and quantitative probability to the role of relative frequency in the measurement of probability. Computational complexity and random sequences are also discussed. Comprised of nine chapters, this book begins with an introduction to different types of probability theories, followed by a detailed account of axiomatic formalizations of comparative and quantitative probability and the relations between them. Subsequent chapters focus on the Kolmogorov formalization of quantitative probability; the common interpretation of probability as a limit of the relative frequency of the number of occurrences of an event in repeated, unlinked trials of a random experiment; an improved theory for repeated random experiments; and the classical theory of probability. The book also examines the origin of subjective probability as a by-product of the development of individual judgments into decisions. Finally, it suggests that none of the known theories of probability covers the whole domain of engineering and scientific practice. This monograph will appeal to students and practitioners in the fields of mathematics and statistics as well as engineering and the physical and social sciences.

The need for a comprehensive survey-type exposition on formal languages and related mainstream areas of computer science has been evident for some years. In the early 1970s, when the book Formal Languages by the second mentioned editor appeared, it was still quite feasible to write a comprehensive book with that title and include also topics of current research interest. This would not be possible anymore. A standard-sized book on formal languages would either have to stay on a fairly low level or else be specialized and restricted to some narrow sector of the field. The setup becomes drastically different in a collection of contributions, where the best authorities in the world join forces, each of them concentrat ing on their own areas of specialization. The present three-volume Handbook constitutes such a unique collection. In these three volumes we present the current state of the art in formallanguage theory. We were most satisfied with the enthusiastic response given to our request for contributions by specialists representing various subfields. The need for a Handbook of Formal Languages was in many answers expressed in different ways: as an easily accessible his torical reference, a general source of information, an overall course-aid, and a compact collection of material for self-study. We are convinced that the final result will satisfy such various needs.