tinyML EMEA 2022 – Elisabetta Farella: Bringing face-swapping to the very edge with Phinets

tinyML EMEA 2022
Algorithms, Software & Tools session
Bringing face-swapping to the very edge with Phinets
Elisabetta Farella, Lead researcher of the Energy Efficient Embedded Digital Architectures, Fondazione Bruno Kessler

Face swapping is a novel AI technique that preserves user privacy in video analytics applications. It is based on the generation of images with synthetic faces in place of the original ones, thus removing sensitive information in the frame. Moreover, performing face swapping at the edge enables an extra layer of security in the data streaming pipeline. This contribution proposes our TinyML approach based on PhiNets applied to Generative Adversarial Networks (GAN) for face swapping. In particular, we targeted a resource-constrained platform based on a low-power microcontroller, a Kendryte K210, with a RISC V dual core working at 400MHz and overall consuming less than 300mW.

source