mks0601 / 3DMPPE_ROOTNET_RELEASE

Official PyTorch implementation of "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019
MIT License
477 stars 65 forks source link

The issue of inaccurate deep prediction #54

Closed YHaooo-4508 closed 1 year ago

YHaooo-4508 commented 1 year ago

I trained for 20 epochs and verified the accuracy. I found that the prediction accuracy of xy is very high, but the prediction accuracy of z value is very poor. Is there a problem with my training or is it just this kind of accuracy.

The accuracy situation is shown in the following figure image

mks0601 commented 1 year ago
Screenshot 2023-07-26 at 11 03 03 PM

As the table shows, that number is similar to the reported ones. Basically, it is very ambiguous to exactly regress absolute depth from a single image, the reason of the high error. But it is better than existing baseline

YHaooo-4508 commented 1 year ago
Screenshot 2023-07-26 at 11 03 03 PM

As the table shows, that number is similar to the reported ones. Basically, it is very ambiguous to exactly regress absolute depth from a single image, the reason of the high error. But it is better than existing baseline

Thank you for your reply. Additionally, I would like to inquire if feature fusion with depth maps can solve this problem. Or, if there is a depth map, there is no need to infer the root point z value anymore?

mks0601 commented 1 year ago

If you have depth maps, the problem becomes much easier, but still, you need to estimate it as depth map provides information of only visible surface. If your root joint is occluded by objects or some other parts of humans, such as arms, then you cannot directly retrieve depth values from the depth map.

YHaooo-4508 commented 1 year ago

If you have depth maps, the problem becomes much easier, but still, you need to estimate it as depth map provides information of only visible surface. If your root joint is occluded by objects or some other parts of humans, such as arms, then you cannot directly retrieve depth values from the depth map.

Thank you again. You have answered my question very well and I will close this issue