TencentARC / CustomNet

Apache License 2.0
258 stars 9 forks source link

Custom community model #7

Open scarbain opened 4 months ago

scarbain commented 4 months ago

Hello, thanks for releasing the model and the code !

If I understand correctly, you directly finetune SD1.5 right ? So is there any way to integrate your model into community pipelines ?For using it with controlnets, ip-adapters and (mostly) with community models such as DreamShaper ?

I guess we could extract a LoRA of Dreamshaper model from SD1.5 base and add it to your model ? But is the other way around possible ?

Just like ControlNet which started as a full finetune of SD1.5 and then the community helped extract the controlnet in such a way it can be used with any community model or custom pipelines.

Thank you for your insights.