lllyasviel / Fooocus

Focus on prompting and generating
GNU General Public License v3.0
41.06k stars 5.77k forks source link

Implement handrefiner #1831

Open nottengame opened 9 months ago

nottengame commented 9 months ago

Found some fresh ControlNet for automatic hand fixing. https://github.com/wenquanlu/HandRefiner

If You add it to the fooocus, perhaps we can finally get the hand generation quality at the midjourney level.

Thank You for your work💪

mashb1t commented 9 months ago

Currently Fooocus does not use automatic refiner steps + does not automatically apply ControlNet adapters, so this is related to https://github.com/lllyasviel/Fooocus/issues/937. As far as i could see, HandRefiner is not an adapter, but a separate project altogether. I'm not sure if this would be easy to implemented, so feel free to use the already included manual hand fixing in inpainting.

donkw commented 9 months ago

Hand fixing... i am a beginner, how do i achieve this.

mashb1t commented 9 months ago

Advanced > Inpaint > hands, face, etc.

donkw commented 9 months ago

Advanced > Inpaint > hands, face, etc.

I found it and it works very well, thank you so much!!! @mashb1t

nottengame commented 9 months ago

Inpainting in "improve detail" mode works good, but not fixing general problem with mutated fingers for example. Inpainting in normal mode can do it good, but you need to make several generations for it.

monkrus commented 9 months ago

@nottengame So much agreed. Hands are a pain. Are there any specific styles/ settings/negative prompts that might improve the initial result? I almost want to see the old-fashioned turn knob to adjust that :)

mashb1t commented 9 months ago

@monkrus there is https://civitai.com/models/200255 as well as https://civitai.com/models/116480, which might help with better hands, but IMHO nothing beats OpenPose (which sadly isn't supported in Fooocus) - haven't tried https://github.com/wenquanlu/HandRefiner though.

monkrus commented 9 months ago

@mashb1t Thank you! Maybe OpenPose is the missing jewel on the crown.

monkrus commented 9 months ago

Just a side note, adding "anatomically correct" often gives better results than "highly detailed" in the "improve detail" section