exx8 / differential-diffusion

336 stars 17 forks source link

Any plan to support stable cascade? #20

Open DENG-XC opened 3 months ago

DENG-XC commented 3 months ago

First, thanks for your team's hard work. I am wonder that will your team support stable cascade in future? or others better diffuse model, such as playground v2.5 and stable diffusion 3.

exx8 commented 3 months ago

Hi sorry for the delay, Thanks for your interest in diff diff. Well I haven't decided what will be the support plan of this paper. When the first pre-print was released only one diffusion architecture was supported. Today there are four, and as you mentioned there are now new diffusion models. It is expected that stable cascade and Stable Diffusion 3 are supported by this framework. I have already seen someone who has used diff diff with Playground: https://twitter.com/ZHOZHO672070/status/1764347618480517597/photo/1 Actually this looks awesome, I wish I had this picture when I wrote the paper. It seems that the paper has been integrated into SD.Next and ComfyUI. If they support these diffusion models, it should work there. I will try to speak with the maintainers of huggingface/diff to see if they are planning to port this paper to other diffusion models.