search

SiTH-Diffusion / SiTH

[CVPR 2024] SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
https://ait.ethz.ch/sith
MIT License
76 stars 3 forks source link

openpose #2

Closed jinnan-chen closed 2 months ago

jinnan-chen commented 2 months ago

Hi, thanks for great work! For openpose preprocessing, how to get the json file as the example given? Just using the offical openpose by Caffe or are there some workaround ways by pytorch? Thanks!

azuxmioy commented 2 months ago

Hi,

We used the original openpose binary and the suggested command to get these JSON files. https://github.com/CMU-Perceptual-Computing-Lab/openpose

Any keypoint detector that produces COCO25 body + hand + face keypoints in a similar format should be compatible.

Please refer to the loading function if you want to use other pose predictors https://github.com/SiTH-Diffusion/SiTH/blob/main/fitting/utils/kps.py#L360

Thanks and best regards!