search

aigc-apps / sd-webui-EasyPhoto

📷 EasyPhoto | Your Smart AI Photo Generator.
Apache License 2.0
4.71k stars 369 forks source link

Feature: Support InstantID #386

Closed hkunzhe closed 4 months ago

hkunzhe commented 5 months ago

Given https://github.com/Mikubill/sd-webui-controlnet/pull/2580, this PR supports the InstantID Control in EasyPhoto inference (both w/ and w/o pretrained LoRAs).

In addition, there are the following changes:

  1. ID Control is enabled by default.
  2. Display Similarity Score is not automatically enabled when ID Control or Infer without User Lora is enabled.

Note:

  1. The InstantID control must be enabled with SDXL checkpoints. If you have less than 20GB VRAM, please turn off Super Resolution at last in EasyPhoto and set Model cache size=1 in ControlNet (requires about 17GB VRAM).
  2. The sd-webui-controlnet introduced the dependency of insightface to support IP-Adapter Face ID and InstantID, although we have removed insightface. To test this PR, please do pip install insightface as I found sd-webui-controlnet does not appear to be executing the install command in Linux.

TODO:

zouxinyi0625 commented 5 months ago

tested.

image

UI may be modified to highlight the use of instance-id. a bug occurred when using IPA only infer (delete L1320 may be outdated.) The latest controlnet needs additional env to install.