fenneishi / Fooocus-ControlNet-SDXL

add more control to fooocus
GNU General Public License v3.0
226 stars 9 forks source link

Mixing Image Prompt and Inpaint doesn't work #23

Closed themez closed 7 months ago

themez commented 7 months ago

Describe the problem When image prompt(controlnet) and inpaint are both enabled, only inpaint is activated, check the result, the table canny is not working

image image image

Full Console Log

[Sampler] refiner_swap_method = joint
[Sampler] sigma_min = 0.02916753850877285, sigma_max = 14.614643096923828
[Sampler] Fooocus sampler is activated.
 67%|████████████████████████████████████████████████████████████████████████████████████████████████████████                                                    | 20/30 [00:07<00:02,  3.43it/s]Requested to load SDXLRefiner
Loading 1 new model
[Fooocus Model Management] Moving model(s) has taken 1.19 seconds
Refiner Swapped
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:11<00:00,  2.56it/s]
Image generated with private log at: /data/workspace/Fooocus-ControlNet-SDXL/outputs/2023-12-22/log.html
Generating and saving time: 14.44 seconds
Requested to load SDXLClipModel
Requested to load GPT2LMHeadModel
Loading 2 new models
[Fooocus Model Management] Moving model(s) has taken 0.47 seconds
Total time: 24.49 seconds
[Parameters] Adaptive CFG = 7
[Parameters] Sharpness = 2
[Parameters] ADM Scale = 1.5 : 0.8 : 0.3
[Parameters] CFG = 7.0
[Fooocus] Downloading inpainter ...
[Inpaint] Current inpaint model is /data/workspace/Fooocus-ControlNet-SDXL/models/inpaint/inpaint.fooocus.patch
[Fooocus] Downloading control models ...
[Fooocus] Loading control models ...
[Parameters] Sampler = dpmpp_2m_sde_gpu - karras
[Parameters] Steps = 30 - 20
[Fooocus] Initializing ...
[Fooocus] Loading models ...
[Fooocus] Processing prompts ...
[Fooocus] Preparing Fooocus text #1 ...
[Prompt Expansion] New suffix: extremely detailed oil painting, unreal 5 render, rhads, Bruce Pennington, Studio Ghibli, tim hildebrandt, digital art, octane render, beautiful composition, trending on artstation, award-winning photograph, masterpiece
[Fooocus] Preparing Fooocus text #2 ...
[Prompt Expansion] New suffix: intricate, elegant, sharp focus, illustration, highly detailed, digital painting, concept art, matte, art by wlop and artgerm and ivan shishkin and andrey shishkin, masterpiece
[Fooocus] Encoding positive #1 ...
[Fooocus Model Management] Moving model(s) has taken 0.13 seconds
[Fooocus] Encoding positive #2 ...
[Fooocus] Encoding negative #1 ...
[Fooocus] Encoding negative #2 ...
[Fooocus] Image processing ...
[Fooocus] VAE encoding ...
[Fooocus] VAE inpaint encoding ...
Final resolution is (1024, 1024), latent is (1024, 1024).
Preparation time: 5.21 seconds
[Sampler] refiner_swap_method = joint
[Sampler] sigma_min = 0.02916753850877285, sigma_max = 14.614643096923828
Requested to load SDXL
Loading 1 new model
[Fooocus Model Management] Moving model(s) has taken 2.99 seconds
[Sampler] Fooocus sampler is activated.
 67%|████████████████████████████████████████████████████████████████████████████████████████████████████████                                                    | 20/30 [00:07<00:02,  3.43it/s]Requested to load SDXLRefiner
Loading 1 new model
[Fooocus Model Management] Moving model(s) has taken 1.19 seconds
Refiner Swapped
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:11<00:00,  2.56it/s]
Image generated with private log at: /data/workspace/Fooocus-ControlNet-SDXL/outputs/2023-12-22/log.html
Generating and saving time: 17.43 seconds
[Sampler] refiner_swap_method = joint
[Sampler] sigma_min = 0.02916753850877285, sigma_max = 14.614643096923828
Requested to load SDXL
Loading 1 new model
[Fooocus Model Management] Moving model(s) has taken 2.90 seconds
[Sampler] Fooocus sampler is activated.
 67%|████████████████████████████████████████████████████████████████████████████████████████████████████████                                                    | 20/30 [00:07<00:02,  3.41it/s]Requested to load SDXLRefiner
Loading 1 new model
[Fooocus Model Management] Moving model(s) has taken 1.20 seconds
Refiner Swapped
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:11<00:00,  2.55it/s]
Image generated with private log at: /data/workspace/Fooocus-ControlNet-SDXL/outputs/2023-12-22/log.html
Generating and saving time: 17.46 seconds
Requested to load SDXLClipModel
Requested to load GPT2LMHeadModel
Loading 2 new models
[Fooocus Model Management] Moving model(s) has taken 0.48 seconds
Total time: 41.95 seconds