Hi! Great paper and great code. While looking at the pipeline calls I noticed that you are concatenating zeroes tensors to the control residuals when running SDXL ControlNet, and I am not sure why after reading the paper+code. Is this needed only for SDXL? I am adapting the controlnet style transfer for SD1 and I don't seem to need to make that modification to the pipeline call function.
Hi! Great paper and great code. While looking at the pipeline calls I noticed that you are concatenating zeroes tensors to the control residuals when running SDXL ControlNet, and I am not sure why after reading the paper+code. Is this needed only for SDXL? I am adapting the controlnet style transfer for SD1 and I don't seem to need to make that modification to the pipeline call function.