Tensorflow lite (or TFLM) for On-Device

usefulsensors / moonshine

Fast and accurate automatic speech recognition (ASR) for edge devices

MIT License

2.07k stars 86 forks source link

Tensorflow lite (or TFLM) for On-Device #44

Open jb-ahn opened 6 days ago

jb-ahn commented 6 days ago

Hi, I am interested in running the model in micro controller. So, Is it possible that converting the model to Tensorflow Lite model and run with it (or with Tensorflow Lite for microcontroller)? Thank you!

csukuangfj commented 6 days ago

Does Raspberry Pi4 belong to the category of micro controller?

keveman commented 6 days ago

We have run it on Raspberry Pi Zero 2W using the CTranslate2 framework. Please look at https://github.com/OpenNMT/CTranslate2/pull/1808 for the PR. I'll be releasing a whl file soon built from this branch, specifically for RPi Zero 2W. If you want to run on a different microcontroller, please let me know which, and I can try to provide options.

jb-ahn commented 12 hours ago

Hi @keveman , Thank you for your reply. I am using HiFi4 of Cadence and TFLM. Is there any hint to convert by tensorflow lite?