search

jinxixiang / color_controlnet

A simple extension of Controlnet for color condition
75 stars 5 forks source link

Use ControlNet as the adapter #8

Open WUMINGCHAzero opened 10 months ago

WUMINGCHAzero commented 10 months ago

Thanks for your great work! I notice that in the latest version, you use controlnet as the adapter for platte control. I have several questions about it:

  1. In the case of the adapter, is controlnet better than t2i adaper?
  2. the training of controlnet as the adapter: a) did you fix the sketch-controlnet and only train the platte controlnet? b) did you train the platte controlnet from sd1.5 checkpoint or use other checkpoint?

Thanks for your time. Hope to hear from you soon.

jinxixiang commented 10 months ago

Hi,

  1. our motivation is to use SAM and color palettes to make it more stable.
  2. (a) yes (b) we use sd1.5