Stochastic Global Optimization

This book examines the main methodological and theoretical developments in stochastic global optimization. It is designed to inspire readers to explore various stochastic methods of global optimization by clearly explaining the main methodological principles and features of the methods. Among the book’s features is a comprehensive study of probabilistic and statistical models underlying the stochastic optimization algorithms.

Ch. 1. Introduction / Gade Pandu Rangaiah -- ch. 2. Formulation and illustration of Luus-Jaakola optimization procedure / Rein Luus -- ch. 3. Adaptive random search and simulated annealing optimizers : algorithms and application issues / Jacek M. Jezowski, Grzegorz Poplewski and Roman Bochenek -- ch. 4. Genetic algorithms in process engineering : developments and implementation issues / Abdunnaser Younes, Ali Elkamel and Shawki Areibi -- ch. 5. Tabu search for global optimization of problems having continuous variables / Sim Mong Kai, Gade Pandu Rangaiah and Mekapati Srinivas -- ch. 6. Differential evolution : method, developments and chemical engineering applications / Chen Shaoqiang, Gade Pandu Rangaiah and Mekapati Srinivas -- ch. 7. Ant colony optimization : details of algorithms suitable for process engineering / V.K. Jayaraman [und weitere] -- ch. 8. Particle swarm optimization for solving NLP and MINLP in chemical engineering / Bassem Jarboui [und weitere] -- ch. 9. An introduction to the harmony search algorithm / Gordon Ingram and Tonghua Zhang -- ch. 10. Meta-heuristics : evaluation and reporting techniques / Abdunnaser Younes, Ali Elkamel and Shawki Areibi -- ch. 11. A hybrid approach for constraint handling in MINLP optimization using stochastic algorithms / G.A. Durand [und weitere] -- ch. 12. Application of Luus-Jaakola optimization procedure to model reduction, parameter estimation and optimal control / Rein Luus -- ch. 13. Phase stability and equilibrium calculations in reactive systems using differential evolution and tabu search / Adrian Bonilla-Petriciolet [und weitere] -- ch. 14. Differential evolution with tabu list for global optimization : evaluation of two versions on benchmark and phase stability problems / Mekapati Srinivas and Gade Pandu Rangaiah -- ch. 15. Application of adaptive random search optimization for solving industrial water allocation problem / Grzegorz Poplewski and Jacek M. Jezowski -- ch. 16. Genetic algorithms formulation for retrofitting heat exchanger network / Roman Bochenek and Jacek M. Jezowski -- ch. 17. Ant colony optimization for classification and feature selection / V.K. Jayaraman [und weitere] -- ch. 18. Constraint programming and genetic algorithm / Prakash R. Kotecha, Mani Bhushan and Ravindra D. Gudi -- ch. 19. Schemes and implementations of parallel stochastic optimization algorithms application of tabu search to chemical engineering problems / B. Lin and D.C. Miller

The field of global optimization has been developing at a rapid pace. There is a journal devoted to the topic, as well as many publications and notable books discussing various aspects of global optimization. This book is intended to complement these other publications with a focus on stochastic methods for global optimization. Stochastic methods, such as simulated annealing and genetic algo rithms, are gaining in popularity among practitioners and engineers be they are relatively easy to program on a computer and may be cause applied to a broad class of global optimization problems. However, the theoretical performance of these stochastic methods is not well under stood. In this book, an attempt is made to describe the theoretical prop erties of several stochastic adaptive search methods. Such a theoretical understanding may allow us to better predict algorithm performance and ultimately design new and improved algorithms. This book consolidates a collection of papers on the analysis and de velopment of stochastic adaptive search. The first chapter introduces random search algorithms. Chapters 2-5 describe the theoretical anal ysis of a progression of algorithms. A main result is that the expected number of iterations for pure adaptive search is linear in dimension for a class of Lipschitz global optimization problems. Chapter 6 discusses algorithms, based on the Hit-and-Run sampling method, that have been developed to approximate the ideal performance of pure random search. The final chapter discusses several applications in engineering that use stochastic adaptive search methods.

This book addresses stochastic optimization procedures in a broad manner. The first part offers an overview of relevant optimization philosophies; the second deals with benchmark problems in depth, by applying a selection of optimization procedures. Written primarily with scientists and students from the physical and engineering sciences in mind, this book addresses a larger community of all who wish to learn about stochastic optimization techniques and how to use them.

This book is dedicated to the 70th birthday of Professor J. Mockus, whose scientific interests include theory and applications of global and discrete optimization, and stochastic programming. The papers for the book were selected because they relate to these topics and also satisfy the criterion of theoretical soundness combined with practical applicability. In addition, the methods for statistical analysis of extremal problems are covered. Although statistical approach to global and discrete optimization is emphasized, applications to optimal design and to mathematical finance are also presented. The results of some subjects (e.g., statistical models based on one-dimensional global optimization) are summarized and the prospects for new developments are justified. Audience: Practitioners, graduate students in mathematics, statistics, computer science and engineering.

Stochastic global optimization methods and applications to chemical, biochemical, pharmaceutical and environmental processes presents various algorithms that include the genetic algorithm, simulated annealing, differential evolution, ant colony optimization, tabu search, particle swarm optimization, artificial bee colony optimization, and cuckoo search algorithm. The design and analysis of these algorithms is studied by applying them to solve various base case and complex optimization problems concerning chemical, biochemical, pharmaceutical, and environmental engineering processes. Design and implementation of various classical and advanced optimization strategies to solve a wide variety of optimization problems makes this book beneficial to graduate students, researchers, and practicing engineers working in multiple domains. This book mainly focuses on stochastic, evolutionary, and artificial intelligence optimization algorithms with a special emphasis on their design, analysis, and implementation to solve complex optimization problems and includes a number of real applications concerning chemical, biochemical, pharmaceutical, and environmental engineering processes. Presents various classical, stochastic, evolutionary, and artificial intelligence optimization algorithms for the benefit of the audience in different domains Outlines design, analysis, and implementation of optimization strategies to solve complex optimization problems of different domains Highlights numerous real applications concerning chemical, biochemical, pharmaceutical, and environmental engineering processes

In the paper we propose a model of tax incentives optimization for inve- ment projects with a help of the mechanism of accelerated depreciation. Unlike the tax holidays which influence on effective income tax rate, accelerated - preciation affects on taxable income. In modern economic practice the state actively use for an attraction of - vestment into the creation of new enterprises such mechanisms as accelerated depreciation and tax holidays. The problem under our consideration is the following. Assume that the state (region) is interested in realization of a certain investment project, for ex- ple, the creation of a new enterprise. In order to attract a potential investor the state decides to use a mechanism of accelerated tax depreciation. The foll- ing question arise. What is a reasonable principle for choosing depreciation rate? From the state’s point of view the future investor’s behavior will be rat- nal. It means that while looking at economic environment the investor choose such a moment for investment which maximizes his expected net present value (NPV) from the given project. For this case both criteria and “investment rule” depend on proposed (by the state) depreciation policy. For the simplicity we will suppose that the purpose of the state for a given project is a maximi- tion of a discounted tax payments into the budget from the enterprise after its creation. Of course, these payments depend on the moment of investor’s entry and, therefore, on the depreciation policy established by the state.

This book examines optimization problems that in practice involve random model parameters. It details the computation of robust optimal solutions, i.e., optimal solutions that are insensitive with respect to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures and differentiation formulas for probabilities and expectations. In the third edition, this book further develops stochastic optimization methods. In particular, it now shows how to apply stochastic optimization methods to the approximate solution of important concrete problems arising in engineering, economics and operations research.