Feature Request: support for new T2i CoAdapter demo models

[AugmentedRealityCat]

Tencent has released a new feature for T2i: Composable Adapters. New models based on that feature have been released on Huggingface. We find the usual suspects over there (depth, canny, etc.) but one of these new 1.5 models has a completely new identity : coadapter-fuser-sd15v1.pth @Dfaker also started a discussion on the subject.

We introduce CoAdapter (Composable Adapter) by jointly training T2I-Adapters and an extra fuser. The fuser allows different adapters with various conditions to be aware of each other and synergize to achieve more powerful composability, especially the combination of element-level style and other structural information.

CoAdapter is inspired by Composer. However, instead of training the whole model, it only trains extra light-weight adapters based on T2I-Adapter. But CoAdapter can also show the capability of generating creative images with composibility. Note that the model is still in training and this release is only a preview.

Sketch	Canny	Depth	Color (Spatial)	Style	Results

[bropines]

Looks like the author died a little -_-.

[setothegreat]

Any updates on this?

[AugmentedRealityCat]

Just to make sure I understand, is this considered implemented because the extension already allows us to mix and match multiple models together (and even mix T2i with ControlNet !) or is that a new feature ? And if it's a new feature, do we have to download the models from the link at the top of this thread ? Do we have to use the Fuser T2i model ?

[setothegreat]

Just to make sure I understand, is this considered implemented because the extension already allows us to mix and match multiple models together (and even mix T2i with ControlNet !) or is that a new feature ? And if it's a new feature, do we have to download the models from the link at the top of this thread ? Do we have to use the Fuser T2i model ?

Not really sure. Author marked this as completed yesterday but I don't see any info in the ReadMe regarding it, nor any reference to the fuser model anywhere in the repo. I admittedly might've just missed it, but none of the commits from yesterday seem to add support for it either.

[ljleb]

most issues have been closed in bulk yesterday. this probably has been closed by mistake. Please close again as not planned if it is not something we intend to implement.

[FlowDownTheRiver]

This is something I am also waiting for. I hope it gets implemented.Looking pretty cool from the examples. Please devs,keep us updated about it.

[amir84ferdos]

Does anybody know how to use the Coadapter fuser?

[AugmentedRealityCat]

As far as I know it is not supported yet by this extension.

[leo27heady]

There're any news about this feature request?