search

lukaszliniewicz / Pandrator

Pandrator aspires to be a user-friendly app with a graphical interface and a one-click installer that creates high-quality speech from text in multiple languages (audiobooks, speech synchronised with subtitles and more) using local models (XTTS, Silero or VoiceCraft), plus voice cloning, LLM pre-processing, RVC enhancement, and automatic evaluation
GNU Affero General Public License v3.0
288 stars 21 forks source link

LLM Processing #39

Open JohnF51 opened 1 day ago

JohnF51 commented 1 day ago

Hi, so first of all a big thanks for the excellent work, very useful app. I admire how you managed to put it all together, I consider it a masterpiece :)

I would like to ask you how to use LLM Processing, when I give load LLM models it prints Failed connect to the LLM API error. I have all the API keys filled in. I am using XTTS model with CUDA. Does it make sense to use LLM with Czech language? And I also want to ask if you have come across Slovak language somewhere. I would need XTTS in Slovak language but I don't know how to train it since it is not supported in available languages. Thank you for your answer. Thank you for your excellent work.

lukaszliniewicz commented 1 day ago

I'm sorry, some features aren't as easy to use to as complete as I would like yet. Currently LLM processing of text can be done only via a local API (I've been using the API of the Text Generation WebUI). The proprietary models are only used for translating subtitles at the moment. I will add them to text processing as well, but it requires a bit of a redesign, because we should then pass larger fragments of texts, not single sentences, to save on prompt input tokens (and they are much more capable, so they can handle that). It should come reasonably soon(ish). As for Slovak, XTTS could be trained for it, but I haven't experimented with that yet. I will have a look and maybe there is a model that supports Slovak out of the box.

JohnF51 commented 8 hours ago

Thank you for your reply. It's great that you are constantly adding to and redesigning the app. I use VSCode if you could find something for Slovak please write thank you. Or if you would like to add something to your application, please send me the manual procedure so I can test the new codes. Thank you again.