facebookresearch / sapiens

High-resolution models for human tasks.
https://about.meta.com/realitylabs/codecavatars/sapiens/
Other
4.53k stars 258 forks source link

Human detection before pose detection #146

Closed rabum closed 1 month ago

rabum commented 1 month ago

What happens when the human detection model didn't detect all the humans in the image, will the pose model detect those undetected humans' body keypoints like when there's no det model used?

rawalkhirodkar commented 1 month ago

@rabum the pose model is top-down. That is we provide the detection bbox image crop as input. In presence of no detection, the pose model will not be used.

Jaykumaran commented 1 month ago

Hello rabum,

I ve discussed the Sapiens on various downstream tasks in a article for LearnOpenCV, if you are interested do checkout for better understanding on how each task is being carried out.

https://learnopencv.com/sapiens-human-vision-models/

The code discussed in the article is based on a simple inference pipeline by https://github.com/ibaiGorordo/Sapiens-Pytorch-Inference

My fork with add ons: https://github.com/Jaykumaran/Sapiens-Pytorch-Inference