search

XLabs-AI / x-flux

Apache License 2.0
1.65k stars 118 forks source link

How to use controlnet for background generation #78

Open appleyang123 opened 3 months ago

appleyang123 commented 3 months ago

I use the canny controlnet code for background generation, but it doesn't seem to work. I switch the canny image into a image only with main object (and pixels in the background are set white) like this:

image

After training 20k steps, and test the results (prompt='a cup of water is on the table') with different controlnet weights (controlnet_gs) from 0.5 to 1.0 controlnet_gs=0.5

image

controlnet_gs=0.7

image

controlnet_gs=1.0

image
thethanksforthegod commented 1 day ago

I am trying the same concept did you reach anything useful?