EvelynFan / FaceFormer

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers
MIT License
778 stars 133 forks source link

Test the demo jitter problem... #28

Open ZerRui opened 2 years ago

ZerRui commented 2 years ago

Hello, in the vocaset demo I tested, the mouth would shake around the 8th second, do you know the reason? look forward to your reply, thank you,Tested directly with your pretrained mode

https://user-images.githubusercontent.com/34739958/174807160-ab52e1bd-fed7-4af0-aee2-3806e90226d5.mp4

l

jerrymatjila commented 1 year ago

I'm also experiencing the same problem using the command

python demo.py --model_name vocaset --wav_path "demo/wav/test.wav" --dataset vocaset --vertice_dim 15069 --feature_dim 64 --period 30  --fps 30  --train_subjects "FaceTalk_170728_03272_TA FaceTalk_170904_00128_TA FaceTalk_170725_00137_TA FaceTalk_170915_00223_TA FaceTalk_170811_03274_TA FaceTalk_170913_03279_TA FaceTalk_170904_03276_TA FaceTalk_170912_03278_TA" --test_subjects "FaceTalk_170809_00138_TA FaceTalk_170731_00024_TA" --condition FaceTalk_170913_03279_TA --subject FaceTalk_170809_00138_TA

https://user-images.githubusercontent.com/68964300/190959742-f9df9025-33fb-4e56-bc67-ccf162578da3.mp4