mkocabas / VIBE

Official implementation of CVPR2020 paper "VIBE: Video Inference for Human Body Pose and Shape Estimation"
https://arxiv.org/abs/1912.05656
Other
2.85k stars 551 forks source link

Hand Motion Capability #250

Closed hshreeshail closed 2 years ago

hshreeshail commented 2 years ago

VIBE does not have the capability to track the motion of finger joints (see attached video as an example) https://user-images.githubusercontent.com/28868617/166939826-525bbf4b-a2fb-48ee-bc53-63196969c4b4.mp4

Is there any follow-up work that has the capability to track hand fingers?

haiderasad commented 2 years ago

@Shreeshail-Hingane try frank mocap https://github.com/facebookresearch/frankmocap , it has both hands plus full body and good results

hshreeshail commented 2 years ago

I see, thanks. I also found other methods that has body + hands + facial expressions functionality: 1] SMPLify-X 2] PIXIE

haiderasad commented 2 years ago

yes, smplify-x is being used in fankmocap as well