search

HyelinNAM / ContrastiveDenoisingScore

[CVPR2024] Official PyTorch implementation of "Contrastive Denoising Score(CDS) for Text-guided Latent Diffusion Image Editing"
https://arxiv.org/abs/2311.18608
88 stars 3 forks source link

Any inspiration source for setting SGD @ lr=0.1 ? #1

Closed jaymefosa closed 9 months ago

jaymefosa commented 9 months ago

https://github.com/HyelinNAM/ContrastiveDenoisingScore/blob/310b15d96f7583623d1e8f3e511fcb37cbf6c969/pipeline_cds.py#L141C45-L141C45

It kind of reminds me of the orthogonal delta rotation network that sets a super high learning rate. Was there any source/reason for this choice?

HyelinNAM commented 9 months ago

Hello @jaymefosa

Most of the configs include learning rate are inherited from official implementation of DDS. (https://github.com/google/prompt-to-prompt/blob/main/DDS_zeroshot.ipynb)