Nonlinear Programming

COMPREHENSIVE COVERAGE OF NONLINEAR PROGRAMMING THEORY AND ALGORITHMS, THOROUGHLY REVISED AND EXPANDED Nonlinear Programming: Theory and Algorithms—now in an extensively updated Third Edition—addresses the problem of optimizing an objective function in the presence of equality and inequality constraints. Many realistic problems cannot be adequately represented as a linear program owing to the nature of the nonlinearity of the objective function and/or the nonlinearity of any constraints. The Third Edition begins with a general introduction to nonlinear programming with illustrative examples and guidelines for model construction. Concentration on the three major parts of nonlinear programming is provided: Convex analysis with discussion of topological properties of convex sets, separation and support of convex sets, polyhedral sets, extreme points and extreme directions of polyhedral sets, and linear programming Optimality conditions and duality with coverage of the nature, interpretation, and value of the classical Fritz John (FJ) and the Karush-Kuhn-Tucker (KKT) optimality conditions; the interrelationships between various proposed constraint qualifications; and Lagrangian duality and saddle point optimality conditions Algorithms and their convergence, with a presentation of algorithms for solving both unconstrained and constrained nonlinear programming problems Important features of the Third Edition include: New topics such as second interior point methods, nonconvex optimization, nondifferentiable optimization, and more Updated discussion and new applications in each chapter Detailed numerical examples and graphical illustrations Essential coverage of modeling and formulating nonlinear programs Simple numerical problems Advanced theoretical exercises The book is a solid reference for professionals as well as a useful text for students in the fields of operations research, management science, industrial engineering, applied mathematics, and also in engineering disciplines that deal with analytical optimization techniques. The logical and self-contained format uniquely covers nonlinear programming techniques with a great depth of information and an abundance of valuable examples and illustrations that showcase the most current advances in nonlinear problems.

This book addresses modern nonlinear programming (NLP) concepts and algorithms, especially as they apply to challenging applications in chemical process engineering. The author provides a firm grounding in fundamental NLP properties and algorithms, and relates them to real-world problem classes in process optimization, thus making the material understandable and useful to chemical engineers and experts in mathematical optimization.

This third edition of the classic textbook in Optimization has been fully revised and updated. It comprehensively covers modern theoretical insights in this crucial computing area, and will be required reading for analysts and operations researchers in a variety of fields. The book connects the purely analytical character of an optimization problem, and the behavior of algorithms used to solve it. Now, the third edition has been completely updated with recent Optimization Methods. The book also has a new co-author, Yinyu Ye of California’s Stanford University, who has written lots of extra material including some on Interior Point Methods.

This book provides a comprehensive introduction to nonlinear programming, featuring a broad range of applications and solution methods in the field of continuous optimization. It begins with a summary of classical results on unconstrained optimization, followed by a wealth of applications from a diverse mix of fields, e.g. location analysis, traffic planning, and water quality management, to name but a few. In turn, the book presents a formal description of optimality conditions, followed by an in-depth discussion of the main solution techniques. Each method is formally described, and then fully solved using a numerical example.

Nonlinear programming provides an excellent opportunity to explore an interesting variety of pure and solidly applicable mathematics, numerical analysis, and computing. This text develops some of the ideas and techniques involved in the optimization methods using calculus, leading to the study of convexity. This is followed by material on basic numerical methods, least squares, the Karush-Kuhn-Tucker theorem, penalty functions, and Lagrange multipliers. The authors have aimed their presentation at the student who has a working knowledge of matrix algebra and advanced calculus, but has had no previous exposure to optimization.

Optimization is one of the most important areas of modern applied mathematics, with applications in fields from engineering and economics to finance, statistics, management science, and medicine. While many books have addressed its various aspects, Nonlinear Optimization is the first comprehensive treatment that will allow graduate students and researchers to understand its modern ideas, principles, and methods within a reasonable time, but without sacrificing mathematical precision. Andrzej Ruszczynski, a leading expert in the optimization of nonlinear stochastic systems, integrates the theory and the methods of nonlinear optimization in a unified, clear, and mathematically rigorous fashion, with detailed and easy-to-follow proofs illustrated by numerous examples and figures. The book covers convex analysis, the theory of optimality conditions, duality theory, and numerical methods for solving unconstrained and constrained optimization problems. It addresses not only classical material but also modern topics such as optimality conditions and numerical methods for problems involving nondifferentiable functions, semidefinite programming, metric regularity and stability theory of set-constrained systems, and sensitivity analysis of optimization problems. Based on a decade's worth of notes the author compiled in successfully teaching the subject, this book will help readers to understand the mathematical foundations of the modern theory and methods of nonlinear optimization and to analyze new problems, develop optimality theory for them, and choose or construct numerical solution methods. It is a must for anyone seriously interested in optimization.

A combination of both Integer Programming and Nonlinear Optimization, this is a powerful book that surveys the field and provides a state-of-the-art treatment of Nonlinear Integer Programming. It is the first book available on the subject. The book aims to bring the theoretical foundation and solution methods for nonlinear integer programming to students and researchers in optimization, operations research, and computer science.