search

initialneil / SplattingAvatar

[CVPR2024] Official implementation of SplattingAvatar.
Other
336 stars 32 forks source link

Rendering images are always with eyes open, even if the ground truth image is with eyes closed #25

Open felixshing opened 2 months ago

felixshing commented 2 months ago

Hi, I am using the "Yufeng" dataset for this work. One interesting phenomenon I found is that we cannot model how much the eye region is open during the inference/rendering process. For example, as shown below, the person in the ground truth image has closed eyes, while the person in the rendered image has open eyes. I also observed that it seems that the degree of human eye opening is almost the same in all frames, which means that we cannot model the degree of human eye opening. What is the root cause of this phenomenon?

image
initialneil commented 2 months ago

The driving parameters used in FLAME did not include eye blink. @felixshing

Xuanmeng-Zhang commented 3 weeks ago

@felixshing @initialneil Hi, I wonder how much time is needed to train such a head avatar.