Deep Learning For Engineers

All engineers and applied scientists will need to harness the power of machine learning to solve the highly complex and data intensive problems now emerging. This text teaches state-of-the-art machine learning technologies to students and practicing engineers from the traditionally “analog” disciplines—mechanical, aerospace, chemical, nuclear, and civil. Dr. McClarren examines these technologies from an engineering perspective and illustrates their specific value to engineers by presenting concrete examples based on physical systems. The book proceeds from basic learning models to deep neural networks, gradually increasing readers’ ability to apply modern machine learning techniques to their current work and to prepare them for future, as yet unknown, problems. Rather than taking a black box approach, the author teaches a broad range of techniques while conveying the kinds of problems best addressed by each. Examples and case studies in controls, dynamics, heat transfer, and other engineering applications are implemented in Python and the libraries scikit-learn and tensorflow, demonstrating how readers can apply the most up-to-date methods to their own problems. The book equally benefits undergraduate engineering students who wish to acquire the skills required by future employers, and practicing engineers who wish to expand and update their problem-solving toolkit.

This book provides a complete illustration of deep learning concepts with case-studies and practical examples useful for real time applications. This book introduces a broad range of topics in deep learning. The authors start with the fundamentals, architectures, tools needed for effective implementation for scientists. They then present technical exposure towards deep learning using Keras, Tensorflow, Pytorch and Python. They proceed with advanced concepts with hands-on sessions for deep learning. Engineers, scientists, researches looking for a practical approach to deep learning will enjoy this book. Presents practical basics to advanced concepts in deep learning and how to apply them through various projects; Discusses topics such as deep learning in smart grids and renewable energy & sustainable development; Explains how to implement advanced techniques in deep learning using Pytorch, Keras, Python programming.

Field-tested tips, tricks, and design patterns for building machine learning projects that are deployable, maintainable, and secure from concept to production. In Machine Learning Engineering in Action, you will learn: Evaluating data science problems to find the most effective solution Scoping a machine learning project for usage expectations and budget Process techniques that minimize wasted effort and speed up production Assessing a project using standardized prototyping work and statistical validation Choosing the right technologies and tools for your project Making your codebase more understandable, maintainable, and testable Automating your troubleshooting and logging practices Ferrying a machine learning project from your data science team to your end users is no easy task. Machine Learning Engineering in Action will help you make it simple. Inside, you’ll find fantastic advice from veteran industry expert Ben Wilson, Principal Resident Solutions Architect at Databricks. Ben introduces his personal toolbox of techniques for building deployable and maintainable production machine learning systems. You’ll learn the importance of Agile methodologies for fast prototyping and conferring with stakeholders, while developing a new appreciation for the importance of planning. Adopting well-established software development standards will help you deliver better code management, and make it easier to test, scale, and even reuse your machine learning code. Every method is explained in a friendly, peer-to-peer style and illustrated with production-ready source code. About the technology Deliver maximum performance from your models and data. This collection of reproducible techniques will help you build stable data pipelines, efficient application workflows, and maintainable models every time. Based on decades of good software engineering practice, machine learning engineering ensures your ML systems are resilient, adaptable, and perform in production. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the book Machine Learning Engineering in Action teaches you core principles and practices for designing, building, and delivering successful machine learning projects. You’ll discover software engineering techniques like conducting experiments on your prototypes and implementing modular design that result in resilient architectures and consistent cross-team communication. Based on the author’s extensive experience, every method in this book has been used to solve real-world projects. What's inside Scoping a machine learning project for usage expectations and budget Choosing the right technologies for your design Making your codebase more understandable, maintainable, and testable Automating your troubleshooting and logging practices About the reader For data scientists who know machine learning and the basics of object-oriented programming. About the author Ben Wilson is Principal Resident Solutions Architect at Databricks, where he developed the Databricks Labs AutoML project, and is an MLflow committer. Table of Contents PART 1 AN INTRODUCTION TO MACHINE LEARNING ENGINEERING 1 What is a machine learning engineer? 2 Your data science could use some engineering 3 Before you model: Planning and scoping a project 4 Before you model: Communication and logistics of projects 5 Experimentation in action: Planning and researching an ML project 6 Experimentation in action: Testing and evaluating a project 7 Experimentation in action: Moving from prototype to MVP 8 Experimentation in action: Finalizing an MVP with MLflow and runtime optimization PART 2 PREPARING FOR PRODUCTION: CREATING MAINTAINABLE ML 9 Modularity for ML: Writing testable and legible code 10 Standards of coding and creating maintainable ML code 11 Model measurement and why it’s so important 12 Holding on to your gains by watching for drift 13 ML development hubris PART 3 DEVELOPING PRODUCTION MACHINE LEARNING CODE 14 Writing production code 15 Quality and acceptance testing 16 Production infrastructure

The most comprehensive book on the engineering aspects of building reliable AI systems. "If you intend to use machine learning to solve business problems at scale, I'm delighted you got your hands on this book." -Cassie Kozyrkov, Chief Decision Scientist at Google "Foundational work about the reality of building machine learning models in production." -Karolis Urbonas, Head of Machine Learning and Science at Amazon

The design patterns in this book capture best practices and solutions to recurring problems in machine learning. The authors, three Google engineers, catalog proven methods to help data scientists tackle common problems throughout the ML process. These design patterns codify the experience of hundreds of experts into straightforward, approachable advice. In this book, you will find detailed explanations of 30 patterns for data and problem representation, operationalization, repeatability, reproducibility, flexibility, explainability, and fairness. Each pattern includes a description of the problem, a variety of potential solutions, and recommendations for choosing the best technique for your situation. You'll learn how to: Identify and mitigate common challenges when training, evaluating, and deploying ML models Represent data for different ML model types, including embeddings, feature crosses, and more Choose the right model type for specific problems Build a robust training loop that uses checkpoints, distribution strategy, and hyperparameter tuning Deploy scalable ML systems that you can retrain and update to reflect new data Interpret model predictions for stakeholders and ensure models are treating users fairly

There is a wealth of literature and books available to engineers starting to understand what machine learning is and how it can be used in their everyday work. This presents the problem of where the engineer should start. The answer is often "for a general, but slightly outdated introduction, read this book; for a detailed survey of methods based on probabilistic models, check this reference; to learn about statistical learning, this text is useful" and so on. This monograph provides the starting point to the literature that every engineer new to machine learning needs. It offers a basic and compact reference that describes key ideas and principles in simple terms and within a unified treatment, encompassing recent developments and pointers to the literature for further study. A Brief Introduction to Machine Learning for Engineers is the entry point to machine learning for students, practitioners, and researchers with an engineering background in probability and linear algebra.

This book discusses various open issues in software engineering, such as the efficiency of automated testing techniques, predictions for cost estimation, data processing, and automatic code generation. Many traditional techniques are available for addressing these problems. But, with the rapid changes in software development, they often prove to be outdated or incapable of handling the software’s complexity. Hence, many previously used methods are proving insufficient to solve the problems now arising in software development. The book highlights a number of unique problems and effective solutions that reflect the state-of-the-art in software engineering. Deep learning is the latest computing technique, and is now gaining popularity in various fields of software engineering. This book explores new trends and experiments that have yielded promising solutions to current challenges in software engineering. As such, it offers a valuable reference guide for a broad audience including systems analysts, software engineers, researchers, graduate students and professors engaged in teaching software engineering.

Deep Learning for Engineers introduces the fundamental principles of deep learning along with an explanation of the basic elements required for understanding and applying deep learning models. As a comprehensive guideline for applying deep learning models in practical settings, this book features an easy-to-understand coding structure using Python and PyTorch with an in-depth explanation of four typical deep learning case studies on image classification, object detection, semantic segmentation, and image captioning. The fundamentals of convolutional neural network (CNN) and recurrent neural network (RNN) architectures and their practical implementations in science and engineering are also discussed. This book includes exercise problems for all case studies focusing on various fine-tuning approaches in deep learning. Science and engineering students at both undergraduate and graduate levels, academic researchers, and industry professionals will find the contents useful.