finding a model for comfy ui for create ai avatar speaker.

Rudrabha / Wav2Lip

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

https://synclabs.so

10.4k stars 2.23k forks source link

finding a model for comfy ui for create ai avatar speaker. #708

Open margo2130 opened 2 weeks ago

margo2130 commented 2 weeks ago

hi. you model only sync lips. do you know any model for comfy ui so we can create ai avatar speaker? i am searching for a comfy ui model that i give him a photo (my avatar) and a voice file , then comfy ui give me ai avatar speaker vieo with lip+eye+face sync. i know there are websites to do it but i want to make it in my local pc for free. i have pretty good gpu.

InnovativeCoder commented 17 hours ago

Just wondering, did you end up finding something, i am in the same boat.

margo2130 commented 13 hours ago

Just wondering, did you end up finding something, i am in the same boat.

the best one is dupdub (website - had a free trial for 1 min video) the best local webui: sadtalker

there is also another website: heygen.

you can find other local projects like v-express but some of them take long time or bad output. you should search. if you find better model, tell me here.