GenAI on the Edge Forum: GenAI and the Transformation of Edge Computing: Leveraging Heterogeneous…

GenAI and the Transformation of Edge Computing: Leveraging Heterogeneous Circuits for Innovation

Jose Angel Miranda CALERO, Post-doc research assistant, Embedded Systems Laboratory, EPFL

The integration of Generative AI (GenAI) into edge devices is pushing the boundaries of technology, from enhancing smartphone photography in real time to enabling immediate voice interactions in smart home systems. This presentation will explore the forefront of GenAI applications and their deployment in embedded systems. The challenge of incorporating GenAI into these systems is significant, as it involves local processing and generation of complex data within the constraints of limited computational resources and energy efficiency. To overcome these challenges, the development of specialized accelerators and the adoption of open-source frameworks are critical. A notable solution in this space involves the use of advanced, heterogeneous integrated circuits, which facilitate the rapid development of flexible and reconfigurable solutions. Such systems, characterized by their versatile processing units, offer the necessary balance between adaptability and computational power essential for GenAI tasks. Illustrative examples, including wearable health monitors providing instant diagnostic feedback, demonstrate the practicality of embedding GenAI in edge devices with appropriate strategies. This approach, focusing on the optimization of these sophisticated integrated circuits, outlines a method to navigate beyond the limitations of existing systems, thereby expanding the potential of GenAI in our daily lives.

source