search

madebyollin / taesd

Tiny AutoEncoder for Stable Diffusion
MIT License
545 stars 27 forks source link

weights for x4 upscaler #4

Closed keturn closed 1 year ago

keturn commented 1 year ago

This is a wonderful project!

What would be involved in getting TAESD for the Stable Diffusion x4 upscaler?

It uses a different VAE than the other Stable Diffusion models.

madebyollin commented 1 year ago

Hmm, it looks like this VAE is f/4 instead of f/8, so I'd need to modify the TAESD arch slightly (and retrain a new set of weights)...

madebyollin commented 1 year ago

Added a stable-diffusion-x4-upscaler-compatible TAESD variant here https://huggingface.co/madebyollin/taesd-x4-upscaler.

Original image: image

TAESD-X4-Upscaler SD-X4-Upscaler VAE
preview_images preview_images_orig
image image
keturn commented 1 year ago

Thanks, I look forward to trying that out soon!