ZhUyU1997 / open-pose-editor

online 3d openpose editor for stable diffusion and controlnet
https://zhuyu1997.github.io/open-pose-editor/
MIT License
782 stars 192 forks source link

Depth map for whole body #20

Open wilq32-unused opened 1 year ago

wilq32-unused commented 1 year ago

Am I missing something? Any chance to get depth map also for whole body? There are some poses that leads to 2d version of pose model that tend to flatter things and things that arm that is "behind" body is now in front of it. I believe that some simple depth map would solve this problem - but for that I believe some mapping to any 3d body object would be needed right?

ZhUyU1997 commented 1 year ago

It needs a perfect 3d human model and may go beyond this tool's meaning. I want it to be kept simple. It is better for professional software like blender to make this request.

shirayu commented 1 year ago

Thank you for this amazing project. Although it's different from the original intention of this issue, if it's possible to display human body parts, we can leave appropriate margins when creating a skeleton map. Sometimes I unintentionally leave insufficient margins, causing generated images to cut off the top of the head.

wilq32-unused commented 1 year ago

@ZhUyU1997 I think it would be enough during export to replace skeleton with cylinders for depth map. For SD with lower than 1 guidance it should be enough to work well, what do you think?

ZhUyU1997 commented 1 year ago

@wilq32-unused I list it in the plan, please wait for the next version