This book aims at the tiny machine learning (TinyML) software and hardware synergy for edge intelligence applications. This book presents on-device learning techniques covering model-level neural network design, algorithm-level training optimization and hardware-level instruction acceleration.

Analyzing the limitations of conventional in-cloud computing would reveal that on-device learning is a promising research direction to meet the requirements of edge intelligence applications. As to the cutting-edge research of TinyML, implementing a high-efficiency learning framework and enabling system-level acceleration is one of the most fundamental issues. This book presents a comprehensive discussion of the latest research progress and provides system-level insights on designing TinyML frameworks, including neural network design, training algorithm optimization and domain-specific hardware acceleration. It identifies the main challenges when deploying TinyML tasks in the real world and guides the researchers to deploy a reliable learning system.

This book will be of interest to students and scholars in the field of edge intelligence, especially to those with sufficient professional Edge AI skills. It will also be an excellent guide for researchers to implement high-performance TinyML systems.

chapter Chapter 1|10 pages


BySong Guo, Qihua Zhou

chapter Chapter 2|14 pages

Fundamentals: On-Device Learning Paradigm

ByQihua Zhou

chapter Chapter 3|20 pages

Preliminary: Theories and Algorithms

ByQihua Zhou, Peiran Dong

chapter Chapter 4|22 pages

Model-Level Design: Computation Acceleration and Communication Saving

ByQihua Zhou, Yi Liu

chapter Chapter 5|16 pages

Hardware-Level Design: Neural Engines and Tensor Accelerators

ByQihua Zhou

chapter Chapter 7|24 pages

System-Level Design: From Standalone to Clusters

ByJie Zhang

chapter Chapter 8|22 pages

Application: Image-Based Visual Perception

ByJingcai Guo, Ziming Liu

chapter Chapter 9|16 pages

Application: Video-Based Real-Time Processing

ByJun Pan, Xun Liu

chapter Chapter 10|26 pages

Application: Privacy, Security, Robustness and Trustworthiness in Edge AI

ByHao Ren, Jjnwen Liang, Zicong Hong, Enyuan Zhou, Junbao Pan