R3gm / SoniTranslate

Synchronized Translation for Videos. Video dubbing
Apache License 2.0
469 stars 106 forks source link

The translation speed is incredible #16

Open zsofts opened 7 months ago

zsofts commented 7 months ago

Hi, Your work is incredible. The translator has become much faster, now it runs 10 times faster (on gpu). Is it possible to speed up RVC processing? When processing, my video card loads by 30%, it would be possible to process it in several threads to speed it up (the option to select threads, if that would be really cool). The same Wishperx uses 100% load on the video card and converts audio into text in just a few seconds.

Also, as I understand, piper tts does not work on Windows [WARNING] >> No module named 'piper' [INFO] >> PIPER TTS disabled

during installation it says: ERROR: Cannot install piper-tts==1.1.0 and piper-tts==1.2.0 because these package versions have conflicting dependencies. Maybe there is some solution?

There is also an excellent fast tts silero: https://github.com/snakers4/silero-models Maybe it will suit you. Choice tts is always good.

Thank you so much for your work!

Slyfoxleo commented 7 months ago

Thank you so much for your work! Incredible project

R3gm commented 7 months ago

Hi, I'll explore options for implementing multithreading in RVC. Regarding Piper TTS on Windows, I haven't tested it. However, I'll look into the Silero TTS you mentioned as a potential addition for optional installation. Thank you.