Fantasy-Studio / Paint-by-Example

Paint by Example: Exemplar-based Image Editing with Diffusion Models
https://arxiv.org/abs/2211.13227
Other
1.08k stars 96 forks source link

Washed out images #37

Closed fujistoo closed 1 year ago

fujistoo commented 1 year ago

I downloaded the original sd-v1.4 from Huggingface and did some finetuning on my dataset, and later on modify the checkpoints accordingly using script/modify_checkpoints.py. I then do the inpainting training using main.py. But the images are washed out. I read something about VAE not included but that shouldn't be the case since we are loading the entire SD-v1.4 right?

Screenshot 2023-06-30 at 4 00 03 PM

image

fujistoo commented 1 year ago

Debugged it. The reason being I didn't normalize the images to Imagenet's distributions.