This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
I am working on a project where users upload an animal image, type a message, and the system converts it into a video of the animal speaking the message using AI-generated speech. While there are platforms like Vidnoze, D-ID Studio, and Lipsync AI by Gooey that offer this for human faces, they don’t seem to work for animal faces.
Is this package suitable for animals?
Has anyone successfully implemented something similar for animals? What tools, models, or techniques would you recommend to get lip sync and eye blinking working for animal images?
I am working on a project where users upload an animal image, type a message, and the system converts it into a video of the animal speaking the message using AI-generated speech. While there are platforms like Vidnoze, D-ID Studio, and Lipsync AI by Gooey that offer this for human faces, they don’t seem to work for animal faces.
Is this package suitable for animals?
Has anyone successfully implemented something similar for animals? What tools, models, or techniques would you recommend to get lip sync and eye blinking working for animal images?