Open mvoodarla opened 2 months ago
Hey folks! My team has been exploring zero-shot lipsyncing for a bit and we think we've improved on MuseTalk's quality quite a bit by using LivePortrait to neutralize expression and CodeFormer to enhance. Here's an example.
https://github.com/user-attachments/assets/cfabcd9f-92e0-4c52-b786-77fc63eef81b
We wrote a technical blog on it: https://www.sievedata.com/blog/sievesync-zero-shot-lipsync-api-developers
Hope to put out an OSS repo soon too :)
Anything we don't talk about in the blog that we should in our repo release?
Hey folks! My team has been exploring zero-shot lipsyncing for a bit and we think we've improved on MuseTalk's quality quite a bit by using LivePortrait to neutralize expression and CodeFormer to enhance. Here's an example.
https://github.com/user-attachments/assets/cfabcd9f-92e0-4c52-b786-77fc63eef81b
We wrote a technical blog on it: https://www.sievedata.com/blog/sievesync-zero-shot-lipsync-api-developers
Hope to put out an OSS repo soon too :)
Anything we don't talk about in the blog that we should in our repo release?