search

yangxy / PASD

[ECCV2024] Pixel-Aware Stable Diffusion for Realistic Image Super-Resolution and Personalized Stylization
Apache License 2.0
889 stars 61 forks source link

very nice work! I want to ask which part of the model is responsible for degradation removal? #4

Open ChenhLiwnl opened 1 year ago

ChenhLiwnl commented 1 year ago

thanks for your work and it is really interesting! However, while reading your code I can't make it clear that which part of the model is responsible for the degradation removal work. in line 927 of train_pasd.py , you calculated F.l1_loss(pixel_values.float(), controlnet_cond_mid.float(), reduction="mean") so you mean controlnet_cond_mid is the denoised image for diffusion model? I'm not sure if I understood your idea

JimmyjhZhang commented 5 months ago

I also have the same question

sacred178953 commented 4 months ago

Maybe it's the RealESRGAN_degradation module in the localdataset.py and webdataset.py files.