Machine Learning On Commodity Tiny Devices

This book aims at the tiny machine learning (TinyML) software and hardware synergy for edge intelligence applications. It presents on-device learning techniques covering model-level neural network design, algorithm-level training optimization, and hardware-level instruction acceleration. Analyzing the limitations of conventional in-cloud computing would reveal that on-device learning is a promising research direction to meet the requirements of edge intelligence applications. As to the cutting-edge research of TinyML, implementing a high-efficiency learning framework and enabling system-level acceleration is one of the most fundamental issues. This book presents a comprehensive discussion of the latest research progress and provides system-level insights on designing TinyML frameworks, including neural network design, training algorithm optimization and domain-specific hardware acceleration. It identifies the main challenges when deploying TinyML tasks in the real world and guides the researchers to deploy a reliable learning system. This volume will be of interest to students and scholars in the field of edge intelligence, especially to those with sufficient professional Edge AI skills. It will also be an excellent guide for researchers to implement high-performance TinyML systems.

Deep learning networks are getting smaller. Much smaller. The Google Assistant team can detect words with a model just 14 kilobytes in size—small enough to run on a microcontroller. With this practical book you’ll enter the field of TinyML, where deep learning and embedded systems combine to make astounding things possible with tiny devices. Pete Warden and Daniel Situnayake explain how you can train models small enough to fit into any environment. Ideal for software and hardware developers who want to build embedded systems using machine learning, this guide walks you through creating a series of TinyML projects, step-by-step. No machine learning or microcontroller experience is necessary. Build a speech recognizer, a camera that detects people, and a magic wand that responds to gestures Work with Arduino and ultra-low-power microcontrollers Learn the essentials of ML and how to train your own models Train models to understand audio, image, and accelerometer data Explore TensorFlow Lite for Microcontrollers, Google’s toolkit for TinyML Debug applications and provide safeguards for privacy and security Optimize latency, energy usage, and model and binary size

Work through over 50 recipes to develop smart applications on Arduino Nano 33 BLE Sense and Raspberry Pi Pico using the power of machine learning Key Features Train and deploy ML models on Arduino Nano 33 BLE Sense and Raspberry Pi Pico Work with different ML frameworks such as TensorFlow Lite for Microcontrollers and Edge Impulse Explore cutting-edge technologies such as microTVM and Arm Ethos-U55 microNPU Book DescriptionThis book explores TinyML, a fast-growing field at the unique intersection of machine learning and embedded systems to make AI ubiquitous with extremely low-powered devices such as microcontrollers. The TinyML Cookbook starts with a practical introduction to this multidisciplinary field to get you up to speed with some of the fundamentals for deploying intelligent applications on Arduino Nano 33 BLE Sense and Raspberry Pi Pico. As you progress, you’ll tackle various problems that you may encounter while prototyping microcontrollers, such as controlling the LED state with GPIO and a push-button, supplying power to microcontrollers with batteries, and more. Next, you’ll cover recipes relating to temperature, humidity, and the three “V” sensors (Voice, Vision, and Vibration) to gain the necessary skills to implement end-to-end smart applications in different scenarios. Later, you’ll learn best practices for building tiny models for memory-constrained microcontrollers. Finally, you’ll explore two of the most recent technologies, microTVM and microNPU that will help you step up your TinyML game. By the end of this book, you’ll be well-versed with best practices and machine learning frameworks to develop ML apps easily on microcontrollers and have a clear understanding of the key aspects to consider during the development phase.What you will learn Understand the relevant microcontroller programming fundamentals Work with real-world sensors such as the microphone, camera, and accelerometer Run on-device machine learning with TensorFlow Lite for Microcontrollers Implement an app that responds to human voice with Edge Impulse Leverage transfer learning to classify indoor rooms with Arduino Nano 33 BLE Sense Create a gesture-recognition app with Raspberry Pi Pico Design a CIFAR-10 model for memory-constrained microcontrollers Run an image classifier on a virtual Arm Ethos-U55 microNPU with microTVM Who this book is for This book is for machine learning developers/engineers interested in developing machine learning applications on microcontrollers through practical examples quickly. Basic familiarity with C/C++, the Python programming language, and the command-line interface (CLI) is required. However, no prior knowledge of microcontrollers is necessary.

This book of Advances in Intelligent and Soft Computing contains accepted papers presented at SOCO 2023 conference held in the beautiful and historic city of Salamanca (Spain) in September 2023. Soft computing represents a collection or set of computational techniques in machine learning, computer science, and some engineering disciplines, which investigate, simulate, and analyze very complex issues and phenomena. After a through peer-review process, the 18th SOCO 2023 International Program Committee selected 61 papers which are published in these conference proceedings and represents an acceptance rate of 60%. In this relevant edition, a particular emphasis was put on the organization of special sessions. Seven special sessions were organized related to relevant topics such as: Time Series Forecasting in Industrial and Environmental Applications, Technological Foundations and Advanced Applications of Drone Systems, Soft Computing Methods in Manufacturing and Management Systems, Efficiency and Explainability in Machine Learning and Soft Computing, Machine Learning and Computer Vision in Industry 4.0, Genetic and Evolutionary Computation in Real World and Industry, and Soft Computing and Hard Computing for a Data Science Process Model. The selection of papers was extremely rigorous to maintain the high quality of the conference. We want to thank the members of the Program Committees for their hard work during the reviewing process. This is a crucial process for creating a high-standard conference; the SOCO conference would not exist without their help.

Learn how to deploy complex machine learning models on single board computers, mobile phones, and microcontrollers KEY FEATURES ● Gain a comprehensive understanding of TinyML's core concepts. ● Learn how to design your own TinyML applications from the ground up. ● Explore cutting-edge models, hardware, and software platforms for developing TinyML. DESCRIPTION TinyML is an innovative technology that empowers small and resource-constrained edge devices with the capabilities of machine learning. If you're interested in deploying machine learning models directly on microcontrollers, single board computers, or mobile phones without relying on continuous cloud connectivity, this book is an ideal resource for you. The book begins with a refresher on Python, covering essential concepts and popular libraries like NumPy and Pandas. It then delves into the fundamentals of neural networks and explores the practical implementation of deep learning using TensorFlow and Keras. Furthermore, the book provides an in-depth overview of TensorFlow Lite, a specialized framework for optimizing and deploying models on edge devices. It also discusses various model optimization techniques that reduce the model size without compromising performance. As the book progresses, it offers a step-by-step guidance on creating deep learning models for object detection and face recognition specifically tailored for the Raspberry Pi. You will also be introduced to the intricacies of deploying TensorFlow Lite applications on real-world edge devices. Lastly, the book explores the exciting possibilities of using TensorFlow Lite on microcontroller units (MCUs), opening up new opportunities for deploying machine learning models on resource-constrained devices. Overall, this book serves as a valuable resource for anyone interested in harnessing the power of machine learning on edge devices. WHAT YOU WILL LEARN ● Explore different hardware and software platforms for designing TinyML. ● Create a deep learning model for object detection using the MobileNet architecture. ● Optimize large neural network models with the TensorFlow Model Optimization Toolkit. ● Explore the capabilities of TensorFlow Lite on microcontrollers. ● Build a face recognition system on a Raspberry Pi. ● Build a keyword detection system on an Arduino Nano. WHO THIS BOOK IS FOR This book is designed for undergraduate and postgraduate students in the fields of Computer Science, Artificial Intelligence, Electronics, and Electrical Engineering, including MSc and MCA programs. It is also a valuable reference for young professionals who have recently entered the industry and wish to enhance their skills. TABLE OF CONTENTS 1. Introduction to TinyML and its Applications 2. Crash Course on Python and TensorFlow Basics 3. Gearing with Deep Learning 4. Experiencing TensorFlow 5. Model Optimization Using TensorFlow 6. Deploying My First TinyML Application 7. Deep Dive into Application Deployment 8. TensorFlow Lite for Microcontrollers 9. Keyword Spotting on Microcontrollers 10. Conclusion and Further Reading Appendix

A step-by-step guide that will teach you how to deploy TinyML on microcontrollers KEY FEATURES ● Deploy machine learning models on edge devices with ease. ● Leverage pre-built AI models and deploy them without writing any code. ● Create smart and efficient IoT solutions with TinyML. DESCRIPTION TinyML, or Tiny Machine Learning, is used to enable machine learning on resource-constrained devices, such as microcontrollers and embedded systems. If you want to leverage these low-cost, low-power but strangely powerful devices, then this book is for you. This book aims to increase accessibility to TinyML applications, particularly for professionals who lack the resources or expertise to develop and deploy them on microcontroller-based boards. The book starts by giving a brief introduction to Artificial Intelligence, including classical methods for solving complex problems. It also familiarizes you with the different ML model development and deployment tools, libraries, and frameworks suitable for embedded devices and microcontrollers. The book will then help you build an Air gesture digit recognition system using the Arduino Nano RP2040 board and an AI project for recognizing keywords using the Syntiant TinyML board. Lastly, the book summarizes the concepts covered and provides a brief introduction to topics such as zero-shot learning, one-shot learning, federated learning, and MLOps. By the end of the book, you will be able to develop and deploy end-to-end Tiny ML solutions with ease. WHAT YOU WILL LEARN ● Learn how to build a Keyword recognition system using the Syntiant TinyML board. ● Learn how to build an air gesture digit recognition system using the Arduino Nano RP2040. ● Learn how to test and deploy models on Edge Impulse and Arduino IDE. ● Get tips to enhance system-level performance. ● Explore different real-world use cases of TinyML across various industries. WHO THIS BOOK IS FOR The book is for IoT developers, System engineers, Software engineers, Hardware engineers, and professionals who are interested in integrating AI into their work. This book is a valuable resource for Engineering undergraduates who are interested in learning about microcontrollers and IoT devices but may not know where to begin. TABLE OF CONTENTS 1. Introduction to AI 2. Traditional ML Lifecycle 3. TinyML Hardware and Software Platforms 4. End-to-End TinyML Deployment Phases 5. Real World Use Cases 6. Practical Experiments with TinyML 7. Advance Implementation with TinyML Board 8. Continuous Improvement 9. Conclusion

The idea behind this book is to simplify the journey of aspiring readers and researchers to understand Big Data, IoT and Machine Learning. It also includes various real-time/offline applications and case studies in the fields of engineering, computer science, information security and cloud computing using modern tools. This book consists of two sections: Section I contains the topics related to Applications of Machine Learning, and Section II addresses issues about Big Data, the Cloud and the Internet of Things. This brings all the related technologies into a single source so that undergraduate and postgraduate students, researchers, academicians and people in industry can easily understand them. Features Addresses the complete data science technologies workflow Explores basic and high-level concepts and services as a manual for those in the industry and at the same time can help beginners to understand both basic and advanced aspects of machine learning Covers data processing and security solutions in IoT and Big Data applications Offers adaptive, robust, scalable and reliable applications to develop solutions for day-to-day problems Presents security issues and data migration techniques of NoSQL databases

This book presents the latest techniques for machine learning based data analytics on IoT edge devices. A comprehensive literature review on neural network compression and machine learning accelerator is presented from both algorithm level optimization and hardware architecture optimization. Coverage focuses on shallow and deep neural network with real applications on smart buildings. The authors also discuss hardware architecture design with coverage focusing on both CMOS based computing systems and the new emerging Resistive Random-Access Memory (RRAM) based systems. Detailed case studies such as indoor positioning, energy management and intrusion detection are also presented for smart buildings.