haofanwang / ControlNet-for-Diffusers

Transfer the ControlNet with any basemodel in diffusers🔥
MIT License
813 stars 48 forks source link

How to generate the pose image from an input image? #2

Closed xuanyuzhang21 closed 1 year ago

xuanyuzhang21 commented 1 year ago

Hi~, thanks for your great work! I was wondering how to generate the pose image from an input image. thanks for your help.

haofanwang commented 1 year ago

@xuanyuzhang21 Thanks for your interest!

There is no constrain, for developers, you can load any pre-trained pose detector (like OpenPose, or from MMPose). Or if you just want to test with several images, you can also directly use this demo to generate pose and just download the pose result.

xuanyuzhang21 commented 1 year ago

Thanks for your quick reply!

haofanwang commented 1 year ago

One thing you should take in mind is that ControlNet may be sensitive to pose format as it is trained with OpenPose samples. So it is recommended to use their suggested pose estimator.