tinyML Summit 2021 Partner Session: Leveraging sparsity to drive fast response times at the edge

tinyML Summit 2021 https://www.tinyml.org/event/summit-2021
Partner Sessions – Edge Applications
“Leveraging sparsity to drive fast response times at the edge”
Orlando MOREIRA, Fellow and Chief Architect, GrAI Matter Labs

Sparsity is the idea that changes in the real world don’t happen everywhere, or all at once. NeuronFlow is novel multi-core processor architecture that exploits all forms of sparsity to deliver a scalable dataflow processing engine for AI applications at the Edge. In this presentation, we will discuss
The importance of fast responses or low latency in Edge AI applications
Metrics for latency and how they map to the Edge AI application performance
How the unique sparsity-exploitation characteristics of NeuronFlow enable real-time live AI applications where fast response times are essential.

source