search

zhuhao-nju / facescape

FaceScape (PAMI2023 & CVPR2020)
833 stars 94 forks source link

Question about 52 expression param #104

Open abcliguanxi opened 1 year ago

abcliguanxi commented 1 year ago

I wanna get the 52 expression coefficients of each expression for each ID。then we can get mesh_vertices through

mesh_vertices = self.core_tensor.dot(id).dot(exp).reshape((-1, 3))

I would be very grateful if you could give me some advice.

prathebaselva commented 12 months ago

I would also like to have this information

xiyichen commented 8 months ago

Have you found those parameters? I'm also looking for them

prathebaselva commented 8 months ago

I did not get them but I used their fit3d and passed in all the 3D vertices instead of the 68 landmarks, optimized for the ID and exp for 5 iterations and extracted them. It doesn't reproduce shape and expression accurately but doesn't deviate too much either. Hope it helps! . I wish they would share the exact ID and exp params too since these small errors in each shape would result in larger average error for comparison metric

xiyichen commented 8 months ago

Thanks! I'll try to fit with the 3D vertices

xiyichen commented 7 months ago

Hi @prathebaselva, which model did you use to fit the 3D vertices? I tried 1.6 but it seems the number of vertices between the model (26278) and the mesh (26317) do not match. I noticed that you also replied in that issue. Did you manage to find a solution?

prathebaselva commented 7 months ago

I used their vertex 16 to 10 or 10 to 16 npy file to do the conversion. do not remember exactly which one i used.

xiyichen commented 7 months ago

turned out it should be 10 to 16. Thank you!