Open MiloMindbender opened 3 years ago
If the goal is to use driving video from a live person to animate a picture of a CG face, what should the model be trained on to get the best results? Videos of humans speaking, videos of CG faces speaking or both?
Both, make sure that they are cropped in the same way.
I've tried driving some synthetic faces (ie: CG rendered faces) with video from a live person and got pretty good results.
If the goal is to use driving video from a live person to animate a picture of a CG face, what should the model be trained on to get the best results? Videos of humans speaking, videos of CG faces speaking or both?
Attached are a couple of synthetic faces I tried in case anyone wants to experiment. This is pretty good for experimenting as it's easy to change around things like hairstyles and such to see if the animation is effected.