search

philgras / neural-head-avatars

Official PyTorch implementation of "Neural Head Avatars from Monocular RGB Videos"
537 stars 74 forks source link

eye blink problem #34

Open eikooczz opened 2 years ago

eikooczz commented 2 years ago

hi~ When "eye blink" in my training data, the corresponding geometry will have strong shaking. Why does this happen? I saw the video on YouTube and the NHA blinked without shaking and I wondered how it was done. Is it because I have a smaller sample of blinks?

eikooczz commented 2 years ago

“These artifacts occur due to the incomplete disentanglement of the expression / pose blendshapes of the underlying 3DMM. They are known limitations to that method.”

1、So mesh defomation when eye close are inevitable, aren't they?
Is there a solution to this problem? 2、Is there no eye close in 3DMM expression parameters(N x 100)? or eye close in 3DMM expression parameters is not study well?