ComfyUI PhotoMaker Plus

ComfyUI implementation for PhotoMaker.

PhotoMaker implementation that follows the ComfyUI way of doing things. The code is memory efficient, fast, and shouldn't break with Comfy updates.

Example workflow that you can load in ComfyUI.

Installation

1. Install ComfyUI.
2. Install through ComfyUI Manager or clone this repo into custom_nodes by running the following commands in a terminal:

   cd ComfyUI/custom_nodes
   git clone https://github.com/shiimizu/ComfyUI-PhotoMaker-Plus.git

3. Download the model from Hugging Face and place it in a photomaker folder in your models folder such as ComfyUI/models/photomaker.

Features of this Plus version

• Better face resemblance by using CLIPImageProcessor like in the original code.
• Automatic PhotoMaker LoRA detection and loading in the LoraLoader nodes.
• Customizable trigger word
• Allows multiple trigger words in the prompt
• Extra nodes such as PhotoMakerStyles and PrepImagesForClipVisionFromPath

Important news

2024-01-24

• Official support for PhotoMaker landed in ComfyUI. Therefore, this repo's name has been changed. The PhotoMakerEncode node is also now PhotoMakerEncodePlus.

2024-01-21

• Due to various node updates and changes, you may have to recreate the node.
• Removed ref_images_path input. Added a PrepImagesForClipVisionFromPath node.

2024-01-18

• No need to manually extract the LoRA that's inside the model anymore.

Citation

@article{li2023photomaker,
  title={PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding},
  author={Li, Zhen and Cao, Mingdeng and Wang, Xintao and Qi, Zhongang and Cheng, Ming-Ming and Shan, Ying},
  booktitle={arXiv preprint arxiv:2312.04461},
  year={2023}
}