space-nuko / ComfyUI-OpenPose-Editor

180 stars 14 forks source link

How do you use this? #3

Open freshlesh3 opened 1 year ago

freshlesh3 commented 1 year ago

I installed with comfyui manager and can't find openpose editor. Also can you explain how to use the patch.

Duemellon commented 1 year ago

Yes. Some details would be helpful please.

andreszs commented 1 year ago

Here's a guide on how to use Controlnet + Openpose in ComfyUI: ComfyUI workflow sample with MultiAreaConditioning, Loras, Openpose and ControlNet

image

Replace the Load Image node with the OpenPose Editor node (right click workflow > Add Node > image > OpenPose Editor) and connect it to your ApplyControlNet image endpoint.

In this workflow openpose is applied twice as a fix for the MultiAreaConditioning plugin. Without this node you must apply it once for the entire image, simply connect the Apply ControlNet CONDITIONING to your KSampler positive directly, and forget about the MultiAreaConditioning node.

shawn-j commented 1 year ago

is there any way to start with a reference image, load that into the openpose editor to tweak the result? that's how it works in A1111. it looks like with this one, you have to manually drag every point for every pose? seems like a bad way to do it?

andreszs commented 1 year ago

The OpenPose editor plugin is limited to manually dragging the points for every pose, just like you said.

Surely there are extensions to extract pose from existing images, however they may or may not work accurately or be compatible with Comfy. You could instead try using pose packs from civitai, or the predefined poses from posemy.art exported as skeleton PNG.

shawn-j commented 1 year ago

That'a how openpose works in auto1111, you have the main openpose model which guesses the pose, then if it gets something wrong you can edit that in the editor.. so not sure what the point is of an addon where you drag every point manually, including fingers & faces?. Is ther a plan to update this one?. There could possibly be a way to save the image from openpose, then load that into the openpose editor?. Roundabout way but it might do it.