search

mindspore-lab / mindone

one for all, Optimal generator with No Exception
https://mindspore-lab.github.io/mindone/
Apache License 2.0
338 stars 63 forks source link

Update ControlNet SDXL inference pipeline and document #326

Closed HaoyangLee closed 5 months ago

zhtmike commented 5 months ago

Btw, I suggest to move the controlnet condition as one part of the GeneralConditioner in SDXL, as it allows easier integration with controlnet condition estimator, like MiDas. Current implementation seems not feasible with the neural network estimators.

HaoyangLee commented 5 months ago

Btw, I suggest to move the controlnet condition as one part of the GeneralConditioner in SDXL, as it allows easier integration with controlnet condition estimator, like MiDas. Current implementation seems not feasible with the neural network estimators.

Good suggestion, can make a separate PR later.