mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
https://localai.io
MIT License
23.72k stars 1.81k forks source link

feat: tortoiseTTS #1016

Closed mudler closed 9 months ago

mudler commented 1 year ago

Is your feature request related to a problem? Please describe. We support rhaspy, bark and now vall-e-x (#1007). Another popular project is https://github.com/neonbjb/tortoise-tts

Describe the solution you'd like A backend for tortoise tts

Describe alternatives you've considered

Additional context Having support for tortoiseTTS too would help not only for users already using it, but allows also LocalAI to be a good benchmarking platform for all the solutions out there.

mudler commented 1 year ago

Also relevant: https://twitter.com/reach_vb/status/1702369875820212608?t=C96cnC9AF5O59bHJ-kIdyw&s=19

Looks like coqui brings tortoiseTTS on par with vall-e-x voice cloning capabilities. Maybe worth putting effort directly into that one.

djmaze commented 10 months ago

The recently released XTTS-v2 is even more exciting.

balisujohn commented 9 months ago

I have started work on tortoise.cpp, which might be of interest https://github.com/balisujohn/tortoise.cpp

mudler commented 9 months ago

https://github.com/mudler/LocalAI/pull/1489