Exercises In Numerical Linear Algebra And Matrix Factorizations

To put the world of linear algebra to advanced use, it is not enough to merely understand the theory; there is a significant gap between the theory of linear algebra and its myriad expressions in nearly every computational domain. To bridge this gap, it is essential to process the theory by solving many exercises, thus obtaining a firmer grasp of its diverse applications. Similarly, from a theoretical perspective, diving into the literature on advanced linear algebra often reveals more and more topics that are deferred to exercises instead of being treated in the main text. As exercises grow more complex and numerous, it becomes increasingly important to provide supporting material and guidelines on how to solve them, supporting students’ learning process. This book provides precisely this type of supporting material for the textbook “Numerical Linear Algebra and Matrix Factorizations,” published as Vol. 22 of Springer’s Texts in Computational Science and Engineering series. Instead of omitting details or merely providing rough outlines, this book offers detailed proofs, and connects the solutions to the corresponding results in the textbook. For the algorithmic exercises the utmost level of detail is provided in the form of MATLAB implementations. Both the textbook and solutions are self-contained. This book and the textbook are of similar length, demonstrating that solutions should not be considered a minor aspect when learning at advanced levels.

After reading this book, students should be able to analyze computational problems in linear algebra such as linear systems, least squares- and eigenvalue problems, and to develop their own algorithms for solving them. Since these problems can be large and difficult to handle, much can be gained by understanding and taking advantage of special structures. This in turn requires a good grasp of basic numerical linear algebra and matrix factorizations. Factoring a matrix into a product of simpler matrices is a crucial tool in numerical linear algebra, because it allows us to tackle complex problems by solving a sequence of easier ones. The main characteristics of this book are as follows: It is self-contained, only assuming that readers have completed first-year calculus and an introductory course on linear algebra, and that they have some experience with solving mathematical problems on a computer. The book provides detailed proofs of virtually all results. Further, its respective parts can be used independently, making it suitable for self-study. The book consists of 15 chapters, divided into five thematically oriented parts. The chapters are designed for a one-week-per-chapter, one-semester course. To facilitate self-study, an introductory chapter includes a brief review of linear algebra.

Accurate and efficient computer algorithms for factoring matrices, solving linear systems of equations, and extracting eigenvalues and eigenvectors. Regardless of the software system used, the book describes and gives examples of the use of modern computer software for numerical linear algebra. It begins with a discussion of the basics of numerical computations, and then describes the relevant properties of matrix inverses, factorisations, matrix and vector norms, and other topics in linear algebra. The book is essentially self- contained, with the topics addressed constituting the essential material for an introductory course in statistical computing. Numerous exercises allow the text to be used for a first course in statistical computing or as supplementary text for various courses that emphasise computations.

Problems involving linear algebra arise in many contexts of scientific computation, either directly or through the replacement of continuous systems by discrete approximations. This introduction covers the practice of matrix algebra and manipulation, and the theory and practice of direct and iterative methods for solving linear simultaneous algebraic equations, inverting matrices, and determining the latent roots and vectors of matrices. Special attention is given to the important problem of error analysis and numerous examples illustrate the procedures recommended in various circumstances. The emphasis is on the reasons for selecting particular numerical methods rather than on programming or coding.

Full of features and applications, this acclaimed textbook for upper undergraduate level and graduate level students includes all the major topics of computational linear algebra, including solution of a system of linear equations, least-squares solutions of linear systems, computation of eigenvalues, eigenvectors, and singular value problems. Drawing from numerous disciplines of science and engineering, the author covers a variety of motivating applications. When a physical problem is posed, the scientific and engineering significance of the solution is clearly stated. Each chapter contains a summary of the important concepts developed in that chapter, suggestions for further reading, and numerous exercises, both theoretical and MATLAB and MATCOM based. The author also provides a list of key words for quick reference. The MATLAB toolkit available online, 'MATCOM', contains implementations of the major algorithms in the book and will enable students to study different algorithms for the same problem, comparing efficiency, stability, and accuracy.

This classic volume covers the fundamentals of two closely related topics: linear systems (linear equations and least-squares) and linear programming (optimizing a linear function subject to linear constraints). For each problem class, stable and efficient numerical algorithms intended for a finite-precision environment are derived and analyzed. While linear algebra and optimization have made huge advances since this book first appeared in 1991, the fundamental principles have not changed. These topics were rarely taught with a unified perspective, and, somewhat surprisingly, this remains true 30 years later. As a result, some of the material in this book can be difficult to find elsewhere—in particular, techniques for updating the LU factorization, descriptions of the simplex method applied to all-inequality form, and the analysis of what happens when using an approximate inverse to solve Ax=b. Numerical Linear Algebra and Optimization is primarily a reference for students who want to learn about numerical techniques for solving linear systems and/or linear programming using the simplex method; however, Chapters 6, 7, and 8 can be used as the text for an upper-division course on linear least squares and linear programming. Understanding is enhanced by numerous exercises.

Nonnegative matrix factorization (NMF) in its modern form has become a standard tool in the analysis of high-dimensional data sets. This book provides a comprehensive and up-to-date account of the most important aspects of the NMF problem and is the first to detail its theoretical aspects, including geometric interpretation, nonnegative rank, complexity, and uniqueness. It explains why understanding these theoretical insights is key to using this computational tool effectively and meaningfully. Nonnegative Matrix Factorization is accessible to a wide audience and is ideal for anyone interested in the workings of NMF. It discusses some new results on the nonnegative rank and the identifiability of NMF and makes available MATLAB codes for readers to run the numerical examples presented in the book. Graduate students starting to work on NMF and researchers interested in better understanding the NMF problem and how they can use it will find this book useful. It can be used in advanced undergraduate and graduate-level courses on numerical linear algebra and on advanced topics in numerical linear algebra and requires only a basic knowledge of linear algebra and optimization.

Numerical Linear Algebra is a concise, insightful, and elegant introduction to the field of numerical linear algebra.