search

uuembodiedsocialai / ProbTalk3D

Other
60 stars 9 forks source link

The dimension of the output is 403, not 406 #3

Open MOr1s2 opened 3 weeks ago

MOr1s2 commented 3 weeks ago

Thank you for your excellent work! I read your paper and it mentioned that the blendshape format used should be the standard FLAME format, i.e. 300+6+100, but I found that the actual output of the model is 403 dimensions. Is there something wrong?

galib360 commented 3 weeks ago

Thanks for your interest. If I understand the question correctly, we leave out the global head pose/rotation (x,y,z = 3 missing params) in the work. So from the output, we use the 300 shape params to give the flame head the shape, 100 expression and 3 (x,y,z) for the jaw bone of the flame head.

MOr1s2 commented 3 weeks ago

Thanks for your interest. If I understand the question correctly, we leave out the global head pose/rotation (x,y,z = 3 missing params) in the work. So from the output, we use the 300 shape params to give the flame head the shape, 100 expression and 3 (x,y,z) for the jaw bone of the flame head.

Thanks for your reply! You did answer my question, but I have another question, according to what you mentioned here, the order of output is shape, expression and then jaw rotation angle?

MOr1s2 commented 3 weeks ago

Thanks for your interest. If I understand the question correctly, we leave out the global head pose/rotation (x,y,z = 3 missing params) in the work. So from the output, we use the 300 shape params to give the flame head the shape, 100 expression and 3 (x,y,z) for the jaw bone of the flame head.

Thanks for your reply! You did answer my question, but I have another question, according to what you mentioned here, the order of output is shape, expression and then jaw rotation angle?

I found the answer in the blender_script.py, its order is shape, exp and jaw. Thanks for your work~

MOr1s2 commented 3 weeks ago

Is there any difference between the FLAME format here and the common FLAME format? I tried to do some post-processing on the output, but the result was strange and not what I expected.

SichunWU commented 1 week ago

Is there any difference between the FLAME format here and the common FLAME format? I tried to do some post-processing on the output, but the result was strange and not what I expected.

No, they are the same. We use the FLAME 2020 template.