Dynamic Programming Of Economic Decisions

Dynamic Programming is the analysis of multistage decision in the sequential mode. It is now widely recognized as a tool of great versatility and power, and is applied to an increasing extent in all phases of economic analysis, operations research, technology, and also in mathematical theory itself. In economics and operations research its impact may someday rival that of linear programming. The importance of this field is made apparent through a growing number of publications. Foremost among these is the pioneering work of Bellman. It was he who originated the basic ideas, formulated the principle of optimality, recognized its power, coined the terminology, and developed many of the present applications. Since then mathe maticians, statisticians, operations researchers, and economists have come in, laying more rigorous foundations [KARLIN, BLACKWELL], and developing in depth such application as to the control of stochastic processes [HoWARD, JEWELL]. The field of inventory control has almost split off as an independent branch of Dynamic Programming on which a great deal of effort has been expended [ARRoW, KARLIN, SCARF], [WIDTIN] , [WAGNER]. Dynamic Programming is also playing an in creasing role in modem mathematical control theory [BELLMAN, Adap tive Control Processes (1961)]. Some of the most exciting work is going on in adaptive programming which is closely related to sequential statistical analysis, particularly in its Bayesian form. In this monograph the reader is introduced to the basic ideas of Dynamic Programming.

Textbook on dynamic programming as methodology of operational research and decision making - covers theoretical aspects, mathematical and research methodology, etc. Bibliographys.

Individuals and families make key decisions that impact many aspects of financial stability and determine the future of the economy. These decisions involve balancing current sacrifice against future benefits. People have to decide how much to invest in health care, exercise, their diet, and insurance. They must decide how much debt to take on, and how much to save. And they make choices about jobs that determine employment and unemployment levels. Forward-Looking Decision Making is about modeling this individual or family-based decision making using an optimizing dynamic programming model. Robert Hall first reviews ideas about dynamic programs and introduces new ideas about numerical solutions and the representation of solved models as Markov processes. He surveys recent research on the parameters of preferences--the intertemporal elasticity of substitution, the Frisch elasticity of labor supply, and the Frisch cross-elasticity. He then examines dynamic programming models applied to health spending, long-term care insurance, employment, entrepreneurial risk-taking, and consumer debt. Linking theory with data and applying them to real-world problems, Forward-Looking Decision Making uses dynamic optimization programming models to shed light on individual behaviors and their economic implications.

A collection of articles which provide examples that demonstrate the application of dynamic programming to a wide variety of decision problems in agriculture.

Humans interact with and are part of the mysterious processes of nature. Inevitably they have to discover how to manage the environment for their long-term survival and benefit. To do this successfully means learning something about the dynamics of natural processes, and then using the knowledge to work with the forces of nature for some desired outcome. These are intriguing and challenging tasks. This book describes a technique which has much to offer in attempting to achieve the latter task. A knowledge of dynamic programming is useful for anyone interested in the optimal management of agricultural and natural resources for two reasons. First, resource management problems are often problems of dynamic optimization. The dynamic programming approach offers insights into the economics of dynamic optimization which can be explained much more simply than can other approaches. Conditions for the optimal management of a resource can be derived using the logic of dynamic programming, taking as a starting point the usual economic definition of the value of a resource which is optimally managed through time. This is set out in Chapter I for a general resource problem with the minimum of mathematics. The results are related to the discrete maximum principle of control theory. In subsequent chapters dynamic programming arguments are used to derive optimality conditions for particular resources.

This thesis addresses the topic of decision making under uncertainty, with particular focus on financial markets. The aim of this research is to support improved decisions in practice, and related to this, to advance our understanding of financial markets. Stochastic optimization provides the tools to determine optimal decisions in uncertain environments, and the optimality conditions of these models produce insights into how financial markets work. To be more concrete, a great deal of financial theory is based on optimality conditions derived from stochastic optimization models. Therefore, an important part of the development of financial theory is to study stochastic optimization models that step-by-step better capture the essence of reality. This is the motivation behind the focus of this thesis, which is to study methods that in relation to prevailing models that underlie financial theory allow additional real-world complexities to be properly modeled. The overall purpose of this thesis is to develop and evaluate stochastic optimization models that support improved decisions under uncertainty on financial markets. The research into stochastic optimization in financial literature has traditionally focused on problem formulations that allow closed-form or `exact' numerical solutions; typically through the application of dynamic programming or optimal control. The focus in this thesis is on two other optimization methods, namely stochastic programming and approximate dynamic programming, which open up opportunities to study new classes of financial problems. More specifically, these optimization methods allow additional and important aspects of many real-world problems to be captured. This thesis contributes with several insights that are relevant for both financial and stochastic optimization literature. First, we show that the modeling of several real-world aspects traditionally not considered in the literature are important components in a model which supports corporate hedging decisions. Specifically, we document the importance of modeling term premia, a rich asset universe and transaction costs. Secondly, we provide two methodological contributions to the stochastic programming literature by: (i) highlighting the challenges of realizing improved decisions through more stages in stochastic programming models; and (ii) developing an importance sampling method that can be used to produce high solution quality with few scenarios. Finally, we design an approximate dynamic programming model that gives close to optimal solutions to the classic, and thus far unsolved, portfolio choice problem with constant relative risk aversion preferences and transaction costs, given many risky assets and a large number of time periods.

An integrated approach to the empirical application of dynamic optimization programming models, for students and researchers. This book is an effective, concise text for students and researchers that combines the tools of dynamic programming with numerical techniques and simulation-based econometric methods. Doing so, it bridges the traditional gap between theoretical and empirical research and offers an integrated framework for studying applied problems in macroeconomics and microeconomics. In part I the authors first review the formal theory of dynamic optimization; they then present the numerical tools and econometric techniques necessary to evaluate the theoretical models. In language accessible to a reader with a limited background in econometrics, they explain most of the methods used in applied dynamic research today, from the estimation of probability in a coin flip to a complicated nonlinear stochastic structural model. These econometric techniques provide the final link between the dynamic programming problem and data. Part II is devoted to the application of dynamic programming to specific areas of applied economics, including the study of business cycles, consumption, and investment behavior. In each instance the authors present the specific optimization problem as a dynamic programming problem, characterize the optimal policy functions, estimate the parameters, and use models for policy evaluation. The original contribution of Dynamic Economics: Quantitative Methods and Applications lies in the integrated approach to the empirical application of dynamic optimization programming models. This integration shows that empirical applications actually complement the underlying theory of optimization, while dynamic programming problems provide needed structure for estimation and policy evaluation.