search

city96 / SD-Latent-Interposer

A small neural network to provide interoperability between the latents generated by the different Stable Diffusion models.
Apache License 2.0
231 stars 9 forks source link

[feature request] StableCascade #6

Closed MoonMoon82 closed 3 months ago

MoonMoon82 commented 7 months ago

After StableCascade has been introduced natively in comfyUI, a direct conversion from stage_b latent to SDXL or SD1.5 latent format would be very useful! But I need to admit, I have no idea if it's even possible..

city96 commented 7 months ago

But I need to admit, I have no idea if it's even possible..

I mean, it should be, if you don't mind the quality being sub-par. I only did a quick test w/ stage C so far to see if I could ditch stage B completely, and that seemed to kinda-sorta work.

image

MoonMoon82 commented 7 months ago

@city96 Sounds interesting! But I don't think it's a good idea to connect to stage_c latent, because - of what I understood - stage_c latent is compressed and stage_b takes over the decoding of the compressed latent. The latent output of stage_b would then be more in my focus.

city96 commented 6 months ago

@MoonMoon82 Hi, a bit late but I finished training some models for stage_b. Also redid the v1/xl stuff to be slightly better. Can you test it if you have the time? They're on the experimental branch for now but I'll merge them to main if everything looks fine.

Edit: Make sure your comfyui is version d7897ff or later for the cascade one.