search

xiexh20 / VisTracker

Official implementation for the CVPR'23 paper: Visibility Aware Human-Object Interaction Tracking from Single RGB Camera
http://virtualhumans.mpi-inf.mpg.de/VisTracker/
67 stars 2 forks source link

Issue about hand pose #4

Open ChrisChenYh opened 1 year ago

ChrisChenYh commented 1 year ago

Many thanks for your great work! I've run the demo scripts successfully and generate the video, however I found that the human hand pose is not predicted correctly, it seems that the pose of hand is initial all the time. And I also notice that you just predict 25 body keypoints by openpose without hand keypoints. I wonder if it's caused by Frankmocap or you just not fit the hand pose. Thanks again and looking forward to your reply! image

xiexh20 commented 1 month ago

Hi, sorry for the late reply. Yes, we do not optimize the hand pose here. It is because the hand is quite heavily occluded in lots of frames. So tracking finger poses is quite difficult. If you don't do it correctly then the fingers will look very unatural. Also the BEHAVE images were captured with hands wearing gloves, which makes the 2D/3D hand pose detection quite noise. These problems make the tracking very difficult.