Integrate new model speech to text model Fish Speech 1.4

huggingface / candle

Minimalist ML framework for Rust

Apache License 2.0

15.84k stars 957 forks source link

Integrate new model speech to text model Fish Speech 1.4 #2472

Open jorgeantonio21 opened 2 months ago

jorgeantonio21 commented 2 months ago

The HuggingFace repository can be found in:

https://huggingface.co/fishaudio/fish-speech-1.4

LaurentMazare commented 2 months ago

Something that could be tricky here is that the license for the code is cc by nc sa, so I don't think we could have an implementation based on the original code in candle-transformers. Two possibilities there:

Make an implementation based on the original code but have it live in another repo.
Use as a basis another implementation which has a more permissive license or only use the research paper (not sure if any of these exist).