search

YuanxunLu / LiveSpeechPortraits

Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation (SIGGRAPH Asia 2021)
MIT License
1.16k stars 200 forks source link

is it possible to apply custom faces? #18

Closed bycloudai closed 2 years ago

bycloudai commented 2 years ago

Hello, thank you for the amazing work!

Is there any possible way to have custom faces? From what I understand, there's only a few faces that are available right now. Are we able to have custom inputs? Or generate the right inputs ourselves?

Thanks again

YuanxunLu commented 2 years ago

This is a person-specific method, so you need to train a new model on the new face data.

yaleimeng commented 2 years ago

@YuanxunLu 从Google Drive下载的预训练模型包含APC_epoch_160.model，以及5个人物文件夹（论文附录中表明使用了8个人物）。也就是说模型可以同时在多个人物上预测。 如果在新的人物角色视频上训练，只使用同一个人的视频可以吗（假设我只需要用这1个人物）？有什么弊端吗？