Mikubill / sd-webui-controlnet

WebUI extension for ControlNet
GNU General Public License v3.0
16.84k stars 1.94k forks source link

[Bug]: Multiple path IP-adapters don't work #2552

Closed George0726 closed 8 months ago

George0726 commented 8 months ago

Is there an existing issue for this?

What happened?

I tried to use the two IP adapters for different usage. i.e. use faceID-based ip-adapter for face control and ip-adapter plus to control the whole region. However, I found that only the latter controlnet unit works.

I am wondering if you guy have any plans to support multiple ip-adapters forward? Many thanks!

Steps to reproduce the problem

  1. Go to ....
  2. Press ....
  3. ...

What should have happened?

I hope that two or more different versions of the IP adapters can work simultaneously

Commit where the problem happens

webui: https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/cf2772fab0af5573da775e7437e6acdca424f26e controlnet: https://github.com/Mikubill/sd-webui-controlnet/commit/7fb40bf803d05cde9ca9db8b1c6b8ee3c5efb352

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

NO

List of enabled extensions

sd-webui-controlnet

Console logs

2024-01-23 01:32:12,673 - ControlNet - INFO - unit_separate = False, style_align = False
2024-01-23 01:32:12,684 - ControlNet - INFO - Loading model: ip-adapter-faceid-plusv2_sd15 [6e14fc1a]
2024-01-23 01:32:13,003 - ControlNet - INFO - Loaded state_dict from [/mnt/nfs/file_server/public/qirui/stable-diffusion-api/models/ControlNet/ip-adapter-faceid-plusv2_sd15.bin]
2024-01-23 01:32:13,004 - ControlNet - INFO - IP-Adapter faceid plus v2 detected.
2024-01-23 01:32:14,968 - ControlNet - INFO - ControlNet model ip-adapter-faceid-plusv2_sd15 [6e14fc1a] loaded.
2024-01-23 01:32:15,116 - ControlNet - INFO - Using preprocessor: ip-adapter_face_id_plus
2024-01-23 01:32:15,116 - ControlNet - INFO - preprocessor resolution = 512
2024-01-23 01:32:15,326 - ControlNet - INFO - Loading model: ip-adapter-faceid-plusv2_sd15 [6e14fc1a]
2024-01-23 01:32:15,584 - ControlNet - INFO - Loaded state_dict from [/mnt/nfs/file_server/public/qirui/stable-diffusion-api/models/ControlNet/ip-adapter-faceid-plusv2_sd15.bin]
2024-01-23 01:32:15,585 - ControlNet - INFO - IP-Adapter faceid plus v2 detected.
2024-01-23 01:32:17,857 - ControlNet - INFO - ControlNet model ip-adapter-faceid-plusv2_sd15 [6e14fc1a] loaded.
2024-01-23 01:32:18,001 - ControlNet - INFO - Using preprocessor: ip-adapter_face_id_plus
2024-01-23 01:32:18,002 - ControlNet - INFO - preprocessor resolution = 512
2024-01-23 01:32:38,330 - ControlNet - INFO - ControlNet Hooked - Time = 25.669766187667847
create sampler  Euler a
100%|_____________________________________________________________________________________________________________________________| 20/20 [00:04<00:00,  4.50it/s]
Total progress: 100%|_____________________________________________________________________________________________________________| 20/20 [00:03<00:00,  5.31it/s]
Total progress: 100%|_____________________________________________________________________________________________________________| 20/20 [00:03<00:00,  9.29it/s]

Additional information

No response

huchenlei commented 8 months ago

Provide full console log please.

I just tested that multiple unit works as expected. Unit 1 1705976124773

Unit 2 1705976143822

Result 1705976160879

huchenlei commented 8 months ago

From console log, it seems like you are using 2 faceid units.