tinyML Asia 2023 – Peter Chang: Benchmarking AI compiler for the TinyML market

Benchmarking AI compiler for the TinyML market
Peter CHANG
Business Development Manager
Skymizer

Machine Learning continues to expand its influence across various domains, AI developers are increasingly focusing on deploying AI models on tiny devices like MCUs. These devices present unique challenges and limitations, such as constrained energy consumption. Skymizer, a company specializing in AI system software, has recognized the potential of AI in such small-scale devices. As a crucial initial stride, Skymizer has provided benchmark figures to the publicly announced MLPerf Tiny v1.1 in June 2023. The demonstration employs two distinct MCUs: one sourced from Skymizer’s partner Nuvoton and another from STMicrocontroller. The primary aim is to showcase the capabilities of Skymizer’s AI compiler, ONNC, when applied to the TinyML market. The outcomes underscore ONNC’s advantages in terms of performance, energy efficiency, and memory utilization. This presentation will begin by introducing the MLPerf Tiny benchmark and delving into our firsthand encounter with the submission process. Subsequently, we will explore the optimization of AI models for hardware from the perspective of a compiler. Lastly, we will share our thoughts on the possibility of the future benchmark designs to accommodate the emerging TinyML market.

source