haofanwang / ControlNet-for-Diffusers

Transfer the ControlNet with any basemodel in diffusers🔥
MIT License
797 stars 47 forks source link

Requires Update to work with Controlnet v1.1 #44

Open ghpkishore opened 1 year ago

ghpkishore commented 1 year ago

Hi @haofanwang ,

This repo would require significant update to work with the latest version of diffusers, given the considerable development of the controlnet pipeline in the month of March. Request you to update this repo. I tried running with my code which I made before but it throws up errors, specifically on model keys, not being able to set pipe.unet.in_channels=4, and so on.

The inpainting pipeline doesn't work with the latest diffusers release.

ghpkishore commented 1 year ago

Given that there is now an inpainting model also released by controlnet, how does that tie up with the inpainting pipeline provided here? How can we use multi control net based inpainting.

haofanwang commented 1 year ago

I will update this repo ASAP. @ghpkishore

ghpkishore commented 1 year ago

Also @haofanwang the script to update the pth files to diffusers might also need rework. The script which worked before, isn't working now.

ghpkishore commented 1 year ago

Hi @haofanwang wanted to check in again. Requesting assistance cause there are no other ways to do multi controlnet inpainting with diffusers without your repo