EvelynFan / FaceFormer

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers
MIT License
778 stars 133 forks source link

trainning problem #25

Open wangjio opened 2 years ago

wangjio commented 2 years ago

The result video has mouth-only motion when I use pre-trained model. But when I use the model trained by myself, the result has whole-face motion. (vocaset)

ZerRui commented 2 years ago

请问你是用的自己的数据训练,还是用的voca的数据训练的?

fastcode3d commented 2 years ago

I also want to get the whole-face motion, but when I use the model trained by my self(vocaset), the result has mouth-only motion, how do you train it?

foocker commented 2 years ago

The result video has mouth-only motion when I use pre-trained model. But when I use the model trained by myself, the result has whole-face motion. (vocaset)

is there only output video ? and the fps is?

ujjawalcse commented 1 year ago

Hey @wangjio , Did you able to train the model by yourself? Please refer the issue i'm getting while training. https://github.com/EvelynFan/FaceFormer/issues/40 Any suggestions are welcome.

JaggerZr commented 1 year ago

The result video has mouth-only motion when I use pre-trained model. But when I use the model trained by myself, the result has whole-face motion. (vocaset)

Can u share the pretrained model, it seems this repo close the shared pretrained model.