search

Inferencer / LipSick

🤢 LipSick: Fast, High Quality, Low Resource Lipsync Tool 🤮
The Unlicense
172 stars 26 forks source link

Faster Time for same video with different audios? #43

Open thatnerdyaigirl opened 2 months ago

thatnerdyaigirl commented 2 months ago

HI I am running gradio on 4090 rtx, for a 30 seconds audio, for the same video, it is waiting so long everytime, just when audio is different. How can I get faster results for same video? image

Inferencer commented 2 months ago

it uses deepspeech to convert the audio into mapped features and its probs using CPU you can get a 40% decrease in audio conversion time using gpu but i didn't figure out a way to use gpu while not affecting the speed of the frame inference as both perform better on different cuda or torch versions I cant remember which, when I did get the audio on gpu the frame inference was super slow