search

geopavlakos / hamer

HaMeR: Reconstructing Hands in 3D with Transformers
https://geopavlakos.github.io/hamer/
MIT License
326 stars 28 forks source link

Any recommended method to render the hands with occlusion? #27

Open JoshMSmith44 opened 6 months ago

JoshMSmith44 commented 6 months ago

From my current understanding, Hamer/VITPose do not predict occlusion or provide a segmentation map of the detected hand. Is there any recommended way to render the hand with occlusion using the existing models? I understand the detectron model can detect persons and provide masks, but this often does not detect hands which are ultimately detected by VITPose. Any advice would be greatly appreciated. Thanks.

GuoPingPan commented 2 weeks ago

image

I also encountered this problem. Even though my finger was occluded, its valid value was still greater than 0.5. How to identify the occluded and non-occluded points? @geopavlakos