search

facebookresearch / detectron2

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
https://detectron2.readthedocs.io/en/latest/
Apache License 2.0
30.48k stars 7.48k forks source link

Rendering DensePose to SMPL body model overtop image #3162

Open alexrichardson21 opened 3 years ago

alexrichardson21 commented 3 years ago

Is it possible to render densepose outputs in the SMPL body model back overtop the original image like the example at the bottom i.e. fit the densepose outputs to SMPL and have .obj and transformation values for each person in an image

densepose smpl

vkhalidov commented 3 years ago

@alexrichardson21 this would require adjusting SMPL pose and shape parameters based on DensePose estimates. This is not in the plans of the DensePose project for now. However, you can check projects related to body pose and shape estimation, such as FrankMocap or EFT.