LizhenWangT / FaceVerse

FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset (CVPR2022)
BSD 2-Clause "Simplified" License
466 stars 58 forks source link

Poor lip tracking #32

Open Inferencer opened 1 year ago

Inferencer commented 1 year ago

Hi I noticed you have been online all day helping people including myself across your projects so I just wanted to say it's much appreciated as I know most of them and it's been a big help.

I wanted to ask about the quality of tracking as the outputs are all such a low resolution (256x256) I figure that's the reason I am getting sub-optimal results with lip-synchronization and if you had any plans to increase the quality, I understand this would come at a cost to speed but without better tracking I don't see much utility in StyleAvatar

please find the files "Driving.mp4" as the Lip-synced video and "Lip-sync.mp4" the result of StyleAvatar https://drive.google.com/drive/folders/1d0yzTnaDM-O4hYV3aXuHJiTMwFZZ10B2?usp=sharing

It could be the case I could just change a few settings or switch to linux for better tracking but I am unsure if this is the case

oijoijcoiejoijce commented 1 year ago

+1