search

alimama-creative / FLUX-Controlnet-Inpainting

441 stars 29 forks source link

Support for multiple controlnet #26

Open runjie-yan opened 3 weeks ago

runjie-yan commented 3 weeks ago

Does this model support for multiple controlnet like depth controlnet? It seems that the model can not be loaded with FluxControlNet in diffusers==0.32.0 (will raise errors). But pasting the controlnet code in this repo will result in other errors. The following is my code:

from diffusers import FluxControlNetModel
from flux_inpaint.pipeline_flux_controlnet_inpaint import FluxControlNetInpaintingPipeline
from flux_inpaint.controlnet_flux import FluxControlNetModel as FluxControlNetInpaintModel

controlnet_list = [
    FluxControlNetInpaintModel.from_pretrained("alimama-creative/FLUX.1-dev-Controlnet-Inpainting-Beta"), # FluxControlNetModel will raise a different error
    FluxControlNetModel.from_pretrained("InstantX/FLUX.1-dev-Controlnet-Union"),
]
pipe = FluxControlNetInpaintingPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", controlnet=controlnet_list)

This gives the following error:

...
File ".../python3.9/site-packages/diffusers/pipelines/pipeline_loading_utils.py", line 735, in _fetch_class_library_tuple
    library = not_compiled_module.__module__.split(".")[0]
AttributeError: 'list' object has no attribute '__module__'
kardecbp commented 3 weeks ago

I am struggling with the same problem. It would be great if there's support for multiple controlnets