Text to Speech MLX model.

ml-explore / mlx-examples

Examples in the MLX framework

MIT License

5.5k stars 791 forks source link

Text to Speech MLX model. #767

Open javileyes opened 1 month ago

javileyes commented 1 month ago

There are MLX models for text generation (llama 3) and for text recognition (whisper) but I think that to have a complete NLP environment it would be necessary to create a text to scpeech MLX. How would it be possible to create, for example, an MLX model of facebook/fastspeech2-en-ljspeech?

awni commented 1 month ago

It should be possible. There is a port of Suno's Bark model already: https://github.com/j-csc/mlx_bark

I think it still depends on PyTorch for the encodec model though.