search

perfanalytics / pose2sim

Markerless kinematics with any cameras — From 2D Pose estimation to 3D OpenSim motion
https://perfanalytics.github.io/pose2sim/
BSD 3-Clause "New" or "Revised" License
271 stars 50 forks source link

I have a question about the input data for Marker Augmentation #119

Closed omnikhk closed 4 months ago

omnikhk commented 4 months ago

It is indicated that at least these locations were required for marker augmentation.

["Neck", "RShoulder", "LShoulder", "RHip", "LHip", "RKnee", "LKnee", "RAnkle", "LAnkle", "RHeel", "LHeel", "RSmallToe", "LSmallToe", "RBigToe", "LBigToe", "RElbow", "LElbow", "RWrist", "LWrist"].

Is this the center point of each location where 2D keypoints are triangulated into 3D? Or, Where the marker was tracked?

davidpagnon commented 4 months ago

Hi, I'm not sure I understand the question. The LSTM needs to have certain inputs, otherwise it fails. Kind of like you cannot solve x = a*b if you don't give a and b as inputs.

And these inputs are the triangulated keypoints with the names you provided. Some 2D pose models, such as Coco 17 for example, don't have feet keypoints, so it would not work.

However, note that we sometimes have better results without marker augmentation, so it may be worth considering not using it.

davidpagnon commented 4 months ago

Closed as stale. Feel free to reopen the issue if you do not consider it has been solved.