search

XgTu / 2DASL

The code (pytorch for testing & matlab for 3D plot and evaluation) for our project: Joint 3D Face Reconstruction and Dense Face Alignment from A Single Image with 2D-Assisted Self-Supervised Learning （2DASL）
MIT License
464 stars 116 forks source link

3D NME #19

Open reshow opened 4 years ago

reshow commented 4 years ago

Hello,thanks for your open source code! I'm getting start to follow the work of PRN, but I cannot really reimplement their work yet. I've read your paper on arxiv and noticed that you compared 2DASL with PRN in experiment part. So I hope you can help me with some problems about the NME metrics.

Do reimplement PRN and get the results or you just evaluate their model? How do you calculate 3D NME and do you have any idea about how do PRN calculate 3D NME?

(I evaluated the model provided in their github on AFLW2000-3D. The 2D NME is alright. But I come up with some problem when calculating 3D NME.

I use exactly the same normalization factor (bounding box size) and calculate the mean L2 distance between ground truth and predicted results. But the 68 kpt 3D NME I got is around 6.0%, which is much higher than PRN paper's 4.4% and similar to 6.12% in your paper.

I've tried to refer to the evaluation code of 3DDFA but it seems that they didn't evaluate 3D coordinates.)

Jiaozrr commented 4 years ago

Puzzled to 3d NME, too. I cannot find an explicit statement...

reshow commented 4 years ago

Puzzled to 3d NME, too. I cannot find an explicit statement...

The paper of 3D-FAN gives a formula of NME. I just cannot get the same 3D results of PRN based on this formula. T.T

Jiaozrr commented 4 years ago

Puzzled to 3d NME, too. I cannot find an explicit statement...

The paper of 3D-FAN gives a formula of NME. I just cannot get the same 3D results of PRN based on this formula. T.T

Thx!

lxzkeyan commented 4 years ago

Puzzled to 3d NME, too. I cannot find an explicit statement...

The paper of 3D-FAN gives a formula of NME. I just cannot get the same 3D results of PRN based on this formula. T.T

How to test 3D reconstruction?Can you share the NME code for testing aflw-2000?