search

lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1
4.68k stars 371 forks source link

What are the differences and advantages between the v1.1 and v1.0? #2

Closed liming-ai closed 1 year ago

liming-ai commented 1 year ago

Hi @lllyasviel,

I noticed that there are mainly two differences between v1.1 and v1.0:

  1. ControlNet v1.1 includes all previous models with improved robustness and result quality. Several new models are added.
  2. Standard ControlNet Naming Rules

What modifications did you make to get better results in v1.1? Did you re-train the model with better data or there are other important changes?

SnowdenLee commented 1 year ago

Also curious about what was the enabler to improve the models :)

lllyasviel commented 1 year ago

they are models trained a bit longer. and some problems in datasets are fixed (for example, our previous dataset included too many greyscale human images making controlnet 1.0 tends to predict greyscale images). the difference between controlnet 1.0 and 1.1 is in some way similar to the difference between SD 1.2 and 1.4

anothertal3 commented 1 year ago

I have been experiencing issues with face quality when using controlnet. Probably similar to this topic: https://github.com/Mikubill/sd-webui-controlnet/issues/232

Can we expect changed behavior in that regard with the new models? (Or isn't this a model-related issue in the first place?)

liming-ai commented 1 year ago

they are models trained a bit longer. and some problems in datasets are fixed (for example, our previous dataset included too many greyscale human images making controlnet 1.0 tends to predict greyscale images). the difference between controlnet 1.0 and 1.1 is in some way similar to the difference between SD 1.2 and 1.4

Thanks for your reply and nice contribution.