Doubiiu / CodeTalker

[CVPR 2023] CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
MIT License
515 stars 57 forks source link

Evaluation Problem: About the Measuring Unit(mm) and testing #70

Open Tankaishen opened 5 months ago

Tankaishen commented 5 months ago

I have imported the .ply file of the template into blender. I found that the Measuring Unit is m not mm. When I use the measure tool to roughly measure the face size of BIWI and vocaset, I found that vocaset might be accurate while BIWI was so big. This seems inconsistent with the evaluation error in paper, not only CodeTalker, but also FaceFormer and other related model. I think if I have missed something? Or the measurement in blender is incompatible with the .ply data? By the way, I wonder how to evaluate the error. I found the one hot input only refers to 8 persons as training set according to the class Dataset _"self.one_hot_labels = np.eye(len(subjectsdict["train"]))" in data_loader.py. But for the test_pred.py, when input the test data of the test subject, the one hot input is still the 8 persons'. I am confused about this. Thanks for answering the issue! QQ截图20240401115157 QQ截图20240401115909