barisgecer / GANFit

Project Page of 'GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction' [CVPR2019]
http://openaccess.thecvf.com/content_CVPR_2019/html/Gecer_GANFIT_Generative_Adversarial_Network_Fitting_for_High_Fidelity_3D_Face_CVPR_2019_paper.html
GNU General Public License v3.0
631 stars 64 forks source link

How to evaluate florence dataset for my model #14

Closed AsiyaNaqvi closed 2 years ago

AsiyaNaqvi commented 3 years ago

Thankyou for providing the code for evaluation.

I am sorry for naive question but what I really can't understand is that of which pictures I have to predict meshes using my model. If we generate meshes of Indoor-Cooperative, PTZ-Indoor, PTZ-Outdoor and compare it with registered ground truth meshes which are in frontal pose and neutral expression but predicted meshses will contain some pose and expression along with shape. How they are comparable with each other? How the frontal 1 or 2 is comparable with Indoor-Cooperative, PTZ-Indoor or PTZ-Outdoor. I hope I made my point here. What should be the file hirerichy of the predicted meshes?

barisgecer commented 2 years ago

What I do, is that choosing 5 random images from each video and estimate a shape per video. Then compare the estimated mesh with the ground truth (minimum of frontal-1 and frontal-2).

A good 3d face reconstruction algorithm is robust to pose and disentangle expression. You can have a look at the paper for some technical background of 3d face reconstruction, or my Ph.D. thesis.