lllyasviel / Fooocus

Focus on prompting and generating
GNU General Public License v3.0
40.52k stars 5.65k forks source link

Native Pony Inpainting #3364

Open xx88xx opened 2 months ago

xx88xx commented 2 months ago

Is there an existing issue for this?

What would your feature do?

As I understand it, the inpainting module (e.g., v2.6) in Fooocus isn’t trained for Pony, so it doesn’t work very well, if at all.

Would it be possible to have a dedicated Pony module (trained on Pony)?

Inpainting is one of the strongest features and main reasons to use Fooocus. It would be amazing to have this feature!

Proposed workflow

When using the pony preset, switch the Inpainting module from the default to a pony Inpainting module.

Additional information

No response

mashb1t commented 2 months ago

@lllyasviel has not yet provided any information about the training of the model in https://github.com/lllyasviel/Fooocus/issues/1967. If you read this, it would be great if you could do so.

kalle07 commented 2 months ago

i have same wishes...

at the moment i use an inpaint-pony model in webforgeUI https://civitai.com/models/245423?modelVersionId=664247

you can use all sliders and options like before in SD15 but yes the inpaint is a bit noisy

kalle07 commented 2 months ago

iv found out that in its strong depend on model but SAMPLER: "ddpm" seems workling well Scheduler: you can play, exponential(more details), lcm(more smooth) ... maybe some other better for you AND its better to use less steps i changed "speed" to 20-30steps

Eagle07-Sudo commented 1 month ago

It seems that creating a model for Flux is now a priority in case there is an intention to create a new inpainting model.

xx88xx commented 1 month ago

It seems that creating a model for Flux is now a priority in case there is an intention to create a new inpainting model.

I agree probably all possible resources should be put into adding flux. Seems the most robust way to move forward

mohamed-benali commented 1 week ago

For Pony you can use this settings on the Developer Debug Mode -> Inpaint imagen

It works well for me including LORAs