search

XLabs-AI / x-flux

Apache License 2.0
1.63k stars 118 forks source link

How to use IP-Adapter + ControlNet #83

Closed jaebbb closed 2 months ago

jaebbb commented 2 months ago

Code

python3 main.py --prompt "handsome guy in the city" --ip_repo_id XLabs-AI/flux-ip-adapter --ip_name flux-ip-adapter.safetensors --device cuda --use_ip --img_prompt assets/example_images/statue.png --control_type canny --repo_id XLabs-AI/flux-controlnet-canny-v3 --name flux-canny-controlnet-v3.safetensors --use_controlnet --image assets/example_images/canny_example2.png

Sample

IP-Adapter image Controlnet image Result
statue canny_example2 result_15
Anghellia commented 2 months ago

Hi, thank you for using our adapters! Currently it works bad as you see (IP-adapter mix with LoRA and ControlNet). We are exploring this issue how can we fix it.