thewh1teagle / vibe

Transcribe on your own!
https://thewh1teagle.github.io/vibe/
MIT License
1.23k stars 73 forks source link

Transcribe music #402

Open thewh1teagle opened 5 days ago

thewh1teagle commented 5 days ago

Describe the feature

It will be great to be able to transcribe music/radio with Vibe. This way we can easily transcribe songs or videos that have music.

we need to integrate vocal separation model (separate music and speech). Currently we can open https://vocalremover.org -> upload the audio -> download the Vocal -> transcribe in Vibe.

thewh1teagle commented 14 hours ago

https://github.com/Anjok07/ultimatevocalremovergui

This is the best open source vocal separator. but written in pytorch. In theory it's possible to rewrite it with onnxruntime so it will be fast, efficient, and lightweight. but require some work.