search

edwko / OuteTTS

Interface for OuteTTS models.
Apache License 2.0
386 stars 23 forks source link

Deploying with LMStudio #13

Open tushar-31093 opened 1 week ago

tushar-31093 commented 1 week ago

Hi Team, I am already using LMStudio and OLLAMA for model deplyments. Given this model is LMCPP compatible and uses that. How can this model be deplyment, hosted and used with LMStudio or OLLAMA. It is merely about model deplyment I suppose as we anyways have to wrap it around Whisper for text ectraction from the audio and pass them both for voice cloing to the api built by wrapping your code.

Help here would be highly appretiated. Really interesting to see it work.

edwko commented 1 week ago

Hey, The model itself can be hosted, and you could use an API to integrate it. You might consider creating a similar class to InterfaceGGUF and modifying the generation function to retrieve prompts from the API. I’ll also look into adding support soon for LMStudio, Ollama, Llama.cpp server, and potentially other APIs.