Deep Learning On Edge Computing Devices

Deep Learning on Edge Computing Devices: Design Challenges of Algorithm and Architecture focuses on hardware architecture and embedded deep learning, including neural networks. The title helps researchers maximize the performance of Edge-deep learning models for mobile computing and other applications by presenting neural network algorithms and hardware design optimization approaches for Edge-deep learning. Applications are introduced in each section, and a comprehensive example, smart surveillance cameras, is presented at the end of the book, integrating innovation in both algorithm and hardware architecture. Structured into three parts, the book covers core concepts, theories and algorithms and architecture optimization. This book provides a solution for researchers looking to maximize the performance of deep learning models on Edge-computing devices through algorithm-hardware co-design. Focuses on hardware architecture and embedded deep learning, including neural networks Brings together neural network algorithm and hardware design optimization approaches to deep learning, alongside real-world applications Considers how Edge computing solves privacy, latency and power consumption concerns related to the use of the Cloud Describes how to maximize the performance of deep learning on Edge-computing devices Presents the latest research on neural network compression coding, deep learning algorithms, chip co-design and intelligent monitoring

As an important enabler for changing people’s lives, advances in artificial intelligence (AI)-based applications and services are on the rise, despite being hindered by efficiency and latency issues. By focusing on deep learning as the most representative technique of AI, this book provides a comprehensive overview of how AI services are being applied to the network edge near the data sources, and demonstrates how AI and edge computing can be mutually beneficial. To do so, it introduces and discusses: 1) edge intelligence and intelligent edge; and 2) their implementation methods and enabling technologies, namely AI training and inference in the customized edge computing framework. Gathering essential information previously scattered across the communication, networking, and AI areas, the book can help readers to understand the connections between key enabling technologies, e.g. a) AI applications in edge; b) AI inference in edge; c) AI training for edge; d) edge computing for AI; and e) using AI to optimize edge. After identifying these five aspects, which are essential for the fusion of edge computing and AI, it discusses current challenges and outlines future trends in achieving more pervasive and fine-grained intelligence with the aid of edge computing.

With the explosive growth of mobile computing and Internet of Things (IoT) applications, as exemplified by AR/VR, smart city, and video/audio surveillance, billions of mobile and IoT devices are being connected to the Internet, generating zillions of bytes of data at the network edge. Driven by this trend, there is an urgent need to push the frontiers of artificial intelligence (AI) to the network edge to fully unleash the potential of IoT big data. Indeed, the marriage of edge computing and AI has resulted in innovative solutions, namely edge intelligence or edge AI. Nevertheless, research and practice on this emerging inter-disciplinary field is still in its infancy stage. To facilitate the dissemination of the recent advances in edge intelligence in both academia and industry, this book conducts a comprehensive and detailed survey of the recent research efforts and also showcases the authors' own research progress on edge intelligence. Specifically, the book first reviews the background and present motivation for AI running at the network edge. Next, it provides an overview of the overarching architectures, frameworks, and emerging key technologies for deep learning models toward training/inference at the network edge. To illustrate the research problems for edge intelligence, the book also showcases four of the authors' own research projects on edge intelligence, ranging from rigorous theoretical analysis to studies based on realistic implementation. Finally, it discusses the applications, marketplace, and future research opportunities of edge intelligence. This emerging interdisciplinary field offers many open problems and yet also tremendous opportunities, and this book only touches the tip of iceberg. Hopefully, this book will elicit escalating attention, stimulate fruitful discussions, and open new directions on edge intelligence.

This book divides edge intelligence into AI for edge (intelligence-enabled edge computing) and AI on edge (artificial intelligence on edge). It focuses on providing optimal solutions to the key concerns in edge computing through effective AI technologies, and it discusses how to build AI models, i.e., model training and inference, on edge. This book provides insights into this new inter-disciplinary field of edge computing from a broader vision and perspective. The authors discuss machine learning algorithms for edge computing as well as the future needs and potential of the technology. The authors also explain the core concepts, frameworks, patterns, and research roadmap, which offer the necessary background for potential future research programs in edge intelligence. The target audience of this book includes academics, research scholars, industrial experts, scientists, and postgraduate students who are working in the field of Internet of Things (IoT) or edge computing and would like to add machine learning to enhance the capabilities of their work. This book explores the following topics: Edge computing, hardware for edge computing AI, and edge virtualization techniques Edge intelligence and deep learning applications, training, and optimization Machine learning algorithms used for edge computing Reviews AI on IoT Discusses future edge computing needs Amitoj Singh is an Associate Professor at the School of Sciences of Emerging Technologies, Jagat Guru Nanak Dev Punjab State Open University, Punjab, India. Vinay Kukreja is a Professor at the Chitkara Institute of Engineering and Technology, Chitkara University, Punjab, India. Taghi Javdani Gandomani is an Assistant Professor at Shahrekord University, Shahrekord, Iran.

This book divides edge intelligence into AI for edge (intelligence-enabled edge computing) and AI on edge (artificial intelligence on edge). It focuses on providing optimal solutions to the key concerns in edge computing through effective AI technologies, and it discusses how to build AI models, i.e., model training and inference, on edge. This book provides insights into this new inter-disciplinary field of edge computing from a broader vision and perspective. The authors discuss machine learning algorithms for edge computing as well as the future needs and potential of the technology. The authors also explain the core concepts, frameworks, patterns, and research roadmap, which offer the necessary background for potential future research programs in edge intelligence. The target audience of this book includes academics, research scholars, industrial experts, scientists, and postgraduate students who are working in the field of Internet of Things (IoT) or edge computing and would like to add machine learning to enhance the capabilities of their work. This book explores the following topics: Edge computing, hardware for edge computing AI, and edge virtualization techniques Edge intelligence and deep learning applications, training, and optimization Machine learning algorithms used for edge computing Reviews AI on IoT Discusses future edge computing needs Amitoj Singh is an Associate Professor at the School of Sciences of Emerging Technologies, Jagat Guru Nanak Dev Punjab State Open University, Punjab, India. Vinay Kukreja is a Professor at the Chitkara Institute of Engineering and Technology, Chitkara University, Punjab, India. Taghi Javdani Gandomani is an Assistant Professor at Shahrekord University, Shahrekord, Iran.

Artificial Intelligence and Machine Learning for Predictive and Analytical Rendering in Edge Computing focuses on the role of AI and machine learning as it impacts and works alongside Edge Computing. Sections cover the growing number of devices and applications in diversified domains of industry, including gaming, speech recognition, medical diagnostics, robotics and computer vision and how they are being driven by Big Data, Artificial Intelligence, Machine Learning and distributed computing, may it be Cloud Computing or the evolving Fog and Edge Computing paradigms. Challenges covered include remote storage and computing, bandwidth overload due to transportation of data from End nodes to Cloud leading in latency issues, security issues in transporting sensitive medical and financial information across larger gaps in points of data generation and computing, as well as design features of Edge nodes to store and run AI/ML algorithms for effective rendering. Provides a reference handbook on the evolution of distributed systems, including Cloud, Fog and Edge Computing Integrates the various Artificial Intelligence and Machine Learning techniques for effective predictions at Edge rather than Cloud or remote Data Centers Provides insight into the features and constraints in Edge Computing and storage, including hardware constraints and the technological/architectural developments that shall overcome those constraints

This book provides an insight into ways of inculcating the need for applying mobile edge data analytics in bioinformatics and medicine. The book is a comprehensive reference that provides an overview of the current state of medical treatments and systems and offers emerging solutions for a more personalized approach to the healthcare field. Topics include deep learning methods for applications in object detection and identification, object tracking, human action recognition, and cross-modal and multimodal data analysis. High performance computing systems for applications in healthcare are also discussed. The contributors also include information on microarray data analysis, sequence analysis, genomics based analytics, disease network analysis, and techniques for big data Analytics and health information technology.

Recent technological developments in sensors, edge computing, connectivity, and artificial intelligence (AI) technologies have accelerated the integration of data analysis based on embedded AI capabilities into resource-constrained, energy-efficient hardware devices for processing information at the network edge. Embedded AI combines embedded machine learning (ML) and deep learning (DL) based on neural networks (NN) architectures such as convolutional NN (CNN), or spiking neural network (SNN) and algorithms on edge devices and implements edge computing capabilities that enable data processing and analysis without optimised connectivity and integration, allowing users to access data from various sources. Embedded AI efficiently implements edge computing and AI processes on resource-constrained devices to mitigate downtime and service latency, and it successfully merges AI processes as a pivotal component in edge computing and embedded system devices. Embedded AI also enables users to reduce costs, communication, and processing time by assembling data and by supporting user requirements without the need for continuous interaction with physical locations. This book provides an overview of the latest research results and activities in industrial embedded AI technologies and applications, based on close cooperation between three large-scale ECSEL JU projects, AI4DI, ANDANTE, and TEMPO. The book’s content targets researchers, designers, developers, academics, post-graduate students and practitioners seeking recent research on embedded AI. It combines the latest developments in embedded AI, addressing methodologies, tools, and techniques to offer insight into technological trends and their use across different industries.