Wonder the performance of finetune

Leminhbinh0209 / FinetuneVAE-SD

Fine-tune VAE of Stable Diffusion model

11 stars 1 forks source link

Wonder the performance of finetune #2

Open eeyrw opened 4 months ago

eeyrw commented 4 months ago

How about new VAE? Does finetune improve the performance significantly?

Leminhbinh0209 commented 4 months ago

Hi, In my own experience, it does help improve visualization quality when trying a smaller image size (< 512). I have not measured with other quantitive metrics.

eeyrw commented 4 months ago

I see. Just another question: why not use VAE implement of diffusers? It seems less dependency such as pytorchlighting.

Leminhbinh0209 commented 4 months ago

actually they are the same, just after training, you can replace vae's weight of diffusion with new weights directly. torchlightning is used simply for stable and easier running on multiple gpus.