nachifur / RDDM

CVPR 2024: Residual Denoising Diffusion Models
https://arxiv.org/abs/2308.13712
259 stars 26 forks source link

Low-Light Experimental settings #10

Closed Allen5123 closed 1 month ago

Allen5123 commented 4 months ago

您好,請問Low-Light Experimental settings 中的 Loss = L_{res}與Sampleing method = SM-Res該如何設置? 目前嘗試以下配置會error objective = "pred_res" test_res_or_noise = "res"

image
nachifur commented 4 months ago

您可以先自行修改和调试一下代码。我们正在逐步地整理和更新代码。

nachifur commented 4 months ago

注意:对于低光照,需修改train.pyequalizeHist=True

Allen5123 commented 4 months ago

謝謝,這部分有注意到,會持續關注後續更新

Allen5123 commented 4 months ago

您好,想請問一些deraining任務的配置 :

  1. sampling均為res + noise 如下 ? objective = 'pred_res_noise' test_res_or_noise = "res_noise"
  2. convert_to_ddim 需要改成False,才會套用Eq(14)的scheduling ?
  3. 原文中P(1-x,1)對應的是linear decreasing還是P(x,1) ? image 4.目前source code中的alphas / beta的schedule是分別對應到Image restoration中的P(1-x,1)與P(x,1)嗎,還是需要另作更改 ? image
  4. Training set是只使用Raindrop/train中的861張image ?
nachifur commented 4 months ago

@Allen5123

  1. Yes, for image restoration, convert_to_ddim=False.

  2. For sampling, L_{res} + L_{\epsilon} (one Adam) needs to modify the loss function. The current code is L_{res}, L_{\epsilon} (two RAdma).

  3. For P(1-x,1), see: https://github.com/nachifur/RDDM/issues/12#issuecomment-2002988560

  4. only Raindrop/train for training.

Allen5123 commented 4 months ago

您好,謝謝回復!

Allen5123 commented 2 months ago

您好,想請問關於image restoration任務的問題:

  1. 如果已將line 640改為convert_to_ddim=False,是否也須一併更改line 726至convert_to_ddim=False ?
  2. 承上,Testing時,line 771 ~ 781這邊的設置與訓練時,使用的alpha, beta scheduling(init內初始化的值)不一樣,理論上,它們應該套用同樣的alpha, beta scheduling ? (e.g.相同的sum_scale, ratio, schedule)
nachifur commented 2 months ago

您好,想請問關於image restoration任務的問題:

  1. 如果已將line 640改為convert_to_ddim=False,是否也須一併更改line 726至convert_to_ddim=False ?
  2. 承上,Testing時,line 771 ~ 781這邊的設置與訓練時,使用的alpha, beta scheduling(init內初始化的值)不一樣,理論上,它們應該套用同樣的alpha, beta scheduling ? (e.g.相同的sum_scale, ratio, schedule)

是的,convert_to_ddim = False in L726

Allen5123 commented 1 month ago

Thanks~