search

justinpinkney / stable-diffusion

MIT License
1.44k stars 261 forks source link

cfg for image variations #28

Closed nikitabalabin closed 1 year ago

nikitabalabin commented 1 year ago

Hello Why do you use uc (unconditional tokens) as zeros for image variations? Did you zero condition with p=0.1 in training process?

justinpinkney commented 1 year ago

yes I zero out with a 10% probability. I use zeros as this seems like a decent null condition, e.g. you can't use an empty string like for the text encoder. I guess you could have done a grey image instead, but not sure if it would make any difference.