tinyML Talks local Sweden meetup: CMSIS-NN & Optimizations for Edge AI

tinyML Talks local Webcast – recorded February 8, 2021
“CMSIS-NN & Optimizations for Edge AI”
Felix Johnny – arm
Fredrik Knutsson – arm

The talk is centered around performance optimizations for Edge AI applications. We’ll begin with identifying bottlenecks in the inference of ML models and move on to ways to handle them. A major part of the solution is in the use of a specialized library like CMSIS-NN which provides optimization for compute-intensive operators targeting Arm Cortex-M processors. Common optimization methodologies used in CMSIS-NN will also be discussed. We have something for model designers by showing how shapes of operators affect performance and some solutions to handle it.
In the end, Fredrik will give a live demo of CMSIS-NN together with TensorFlow Lite for Microcontrollers showcasing the benefits of optimization using an Arduino Nano 33 BLE sense board.

source