search

ZiqiaoPeng / SyncTalk

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"
https://ziqiaopeng.github.io/synctalk/
Other
1.08k stars 121 forks source link

Bad keypoints #100

Open G-force78 opened 2 months ago

G-force78 commented 2 months ago

I have tried different size videos and settings, matched May video at 512x512 but the problem persists, for some reason they are located on the side of the head

keypts keyptsA29

fengxiang777 commented 2 months ago

Can you describe it in detail, does it mean that the head posture does not change?

G-force78 commented 2 months ago

Can you describe it in detail, does it mean that the head posture does not change?

This is from the May video, I assume they are to be used to track the movement, so if they are not marked properly the ned result will fail. maykeypoints

523997931 commented 3 weeks ago

I met the same problem, in my case the keypoints file even empty, I think because of this, my result face jitter, did you know how to solve this

G-force78 commented 3 weeks ago

I met the same problem, in my case the keypoints file even empty, I think because of this, my result face jitter, did you know how to solve this

Longer videos provide better results