search

ZhUyU1997 / open-pose-editor

online 3d openpose editor for stable diffusion and controlnet
https://zhuyu1997.github.io/open-pose-editor/
MIT License
761 stars 188 forks source link

Needs more control #75

Open OpenDrawersNDice opened 1 year ago

OpenDrawersNDice commented 1 year ago

So for fiddling with this I find that the controls are very counter intuitive. The skeleton exists in that way because those colored lines is what stable diffusion reads as the pose... However that's not how a persons bones should be rotated in order to make realistic poses. I think the model would work better with an auto rigger, treat it like a character to be animated. and have the traditional set of controls for posing. Dont use the bones here as rigged bones, treat them like the geo of a character, give it a cog, hip chest and head bonding boxes, not to be read by stable diffusion but as a guide to how a person should be posed. Maybe even add in a transparent stick man over top the colored bones to help the user visual the pose they are making. And definitely have IK feat so they can be planted on the ground plane.

DHG-Dav commented 7 months ago

you can have that in blender though, there are extensions doing exactly that.