mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.07k stars 1.56k forks source link

[Feature Request] whisper support for voice interaction #926

Open jooray opened 1 year ago

jooray commented 1 year ago

🚀 Feature

It would be great if you could support whisper voice recognition on the phone with for example whisper.cpp. Maybe in cooperation with Hello Transcribe. This way you could interact with voice with the LLM.

Motivation

Offline and on the go interaction with the LLM with voice brings the future to the present! It's immensly cool.

Alternatives

Alternative would be to use keyboards with voice support. But it sucks, whisper is much better and multilingual.

jamestwhedbee commented 1 year ago

Would love to see this as well

tqchen commented 1 year ago

Thanks for the suggestion. This is something that we are planning to do with broader set of model support. We are ramping up some infrastructures and looking to have something in later part of the quarter

nundys commented 11 months ago

This would be great

raj-khare commented 8 months ago

hey -- any update on this?

MrRace commented 7 months ago

wish+10086!