huawei-noah / noah-research

Noah Research
867 stars 162 forks source link

[CLIFF]about testing code #137

Open LightOfMonet opened 1 year ago

LightOfMonet commented 1 year ago

Where is the testing code? How can I trust the sota values of your model?

zhihaolee commented 1 year ago

Please refer to #94.

LightOfMonet commented 1 year ago

ok! thanks for the great work

LightOfMonet commented 1 year ago

When I was recreate your work, my PAMPJPE was larger than 60, I think the data on my side was not aligned. Can I ask you a few questions?

  1. How did you deal with Human3.6m and 3DPW? I see other works that provides annotations for native coordinate systems, such as SPIN and PyMAF. Can I just use their label here, and then convert smpl directly to f=√w2 + h2? By the following:

    image

    Or I have to compute global_t, like global_t in the Pseudo-GT you provided?

  2. The f of 3DPW training set is calibrated f and its global_t is calculated. Can I still supervise 2d reprojection loss and smpl 3d loss with f=√w2 + h2?

  3. Is it necessary to supervise global_t? Is global_t supervised after cam_crop2full ()?

    image
zhihaolee commented 1 year ago