tinyML Summit 2021 tiny Talks: Using Neural Architecture Search for Speech Recognition on the Edge
tinyML Summit 2021 https://www.tinyml.org/event/summit-2021
“Using Neural Architecture Search for Speech Recognition on the Edge”
Vikrant TOMAR, Founder and CTO, Fluent.ai
Despite recent developments in machine learning, finding an optimal solution for a given task remains a challenging and time-consuming task often requiring significant efforts in designing and tuning the neural architectures by an expert instead. This problem is more pronounced for TinyML solutions, where, due to limited computational resources, specific models are needed for a given task. To this end, we present a two-step solution. The first step employs GNASIL[2], a novel automated machine learning solution, for discovering an optimal neural architecture within a predefined limit of device specifications in FLOPS. The second step compresses the discovered architecture and make it even smaller.
GNASIL trains a soft actor-critic [2] reinforcement learning agent that expedites the discovery process by extending learning with planning options based upon past experiences and imitation learning through available expert-designed architectures on similar tasks. The architectures discovered by GNASIL are then compressed with automatic model compression (AMC)[3]. AMC uses DDPG [4] to learn the ratio of pruning for each layer. Reward is a function of accuracy and FLOPS. Optimal pruning is achieved in a way that has minimal effect on accuracy of the model despite often reducing the overall model footprint.
Our experiments on a series of on-device speech recognition tasks demonstrate that GNASIL can design neural models with competitive performance in terms of both discovery speed and the accuracy of the discovered architectures, all within the predefined FLOPS restrictions. Further, AMC is able to reduce the size of the model up to 40% without compromising accuracy.
References:
[1] Farzaneh S Fard, Arash Rad, Vikrant Singh Tomar. Nasil: Neural Architecture Search with Imitation Learning, ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
[2] Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International Conference on Machine Learning, pages 1856–1865, 2018.
[3] Yihui He, Ji Lin, Zhijian Liu, Hanrui Wang, Li-Jia Li, and Song Han. Amc: Automl for model compression and acceleration on mobile devices. In Pro- ceedings of the European Conference on Computer Vision (ECCV), pages 784–800, 2018.
[4] Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971, 2015.
source
sildenafil 50mg brand – viagra 50mg brand buy viagra 50mg generic
buy prednisolone 5mg online – neurontin 100mg canada tadalafil 40mg tablet
order augmentin 375mg pill – buy tadalafil 10mg generic order tadalafil online cheap
sulfamethoxazole sale – buy bactrim 960mg sale order sildenafil for sale
cephalexin 500mg usa – order erythromycin 500mg without prescription purchase erythromycin sale
buy fildena generic – stromectol tablet stromectol tablets buy online
buy rhinocort – antabuse 250mg for sale order antabuse 500mg generic
brand cefuroxime – order cefuroxime 500mg generic brand tadalafil 10mg
amoxil 250mg us – buy levitra 20mg pills order levitra 20mg generic
ivermectin 6 mg for humans for sale – purchase levitra online cheap purchase levitra generic
order doxycycline pills – cost cialis 10mg cost tadalafil 10mg
order tadalafil pill – modafinil 200mg cheap buy modafinil without prescription
deltasone medication – online ed pills buy isotretinoin generic
order amoxil 250mg – generic azithromycin 250mg oral viagra
prednisolone 10mg cheap – buy generic gabapentin 600mg viagra 100mg drug
order lasix generic – buy generic doxycycline 100mg ivermectin 4000
plaquenil pill – buy generic chloroquine 250mg baricitinib 4mg price
order metformin 1000mg generic – oral glucophage 1000mg purchase norvasc pills
buy lisinopril 10mg without prescription – lisinopril 5mg cheap atenolol 100mg over the counter
vardenafil 20mg tablet – methylprednisolone 8 mg pills clomid canada
order ventolin inhalator online – helpwithassignment dapoxetine 90mg cheap
ed meds online without doctor prescription canadian drugs online
https://drwithoutdoctorprescription.online/# non prescription ed pills
prescription drugs without doctor approval buy prescription drugs without doctor
buy prescription drugs without doctor buy prescription drugs from canada
order synthroid without prescription – oral desloratadine hydroxychloroquine us
cialis coupon – order cialis 10mg online cheap viagra 50mg cheap
prednisone 20mg uk – order accutane online cheap amoxicillin us
viagra for men buying viagra online
order diltiazem 180mg generic – diltiazem price buy neurontin 100mg generic
lasix tablet – allopurinol 300mg us doxycycline 100mg sale
over the counter viagra over the counter viagra
order cenforce sale – buy cenforce 50mg online domperidone tablet
viagra 100mg price order viagra online
sildenafil 20 mg best over the counter viagra
viagra 50mg – viagra 100mg price cialis 20mg brand
amoxicillin cephalexin antibiotic amoxicillin
online doxycycline prescription pharmacy prices for doxycycline
order modafinil 200mg sale – modafinil 200mg brand order rhinocort pill
https://clomidforsale.life/# buy clomid india
zithromax 250 mg pill zithromax cost canada
buy amoxicillin 500mg where to buy amoxicillin 500mg
brand isotretinoin 10mg – amoxicillin sale order tetracycline 250mg online cheap
https://buytadalafil.men/# tadalafil from india
order cyclobenzaprine 15mg – purchase colchicine online cheap inderal 10mg uk
tamoxifen generic tamoxifen side effects forum
https://buynolvadex.store/# what happens when you stop taking tamoxifen
lipitor 10 mg cost can i buy lipitor over the counter
https://buymetformin.best/# metformin over the counter canada
metformin tab price where to get metformin in canada
brand plavix 150mg – plavix for sale online metoclopramide order online
cipro pharmacy ciprofloxacin 500 mg tablet price
https://withoutprescription.store/# prescription drugs
non prescription ed drugs canadian pharmacy online
cozaar 25mg ca – buy nexium 20mg generic promethazine 25mg brand
https://withoutprescription.store/# ed prescription drugs
male ed pills natural ed remedies
https://cipro.best/# ciprofloxacin over the counter
https://gabapentin.icu/# neurontin price comparison
ciprofloxacin mail online cipro pharmacy