openxrlab / xrmocap

OpenXRLab Multi-view Motion Capture Toolbox and Benchmark
https://xrmocap.readthedocs.io/
Other
340 stars 42 forks source link

2D keypoints Detection #128

Closed 3huo closed 11 months ago

3huo commented 1 year ago

When I use the defalt 2d keypoints detector i.e. mmpose_hrnet_w48_coco_wholebody_384x288_dark_plus.py I get a wrong 2d keypoint result about the big_toe and small_toe points. I wonder if it is the kpts detector's fault or some other resons?

LazyBusyYang commented 1 year ago

Yes, I have also encountered the same issue during the use of XRMoCap. It may be possible to solve this problem by replacing the MMPose model with another one, but I have not tried yet.
Also, accepting incorrect 2D detection results is OK. Adjusting the SMPLify parameters can reduce the impact of incorrect toe positions. For SMPLify(X) parameters, please ask @wqyin.