NVlabs / edm2

Analyzing and Improving the Training Dynamics of Diffusion Models (EDM2)
Other
479 stars 19 forks source link

Choice of hyperparameter values #2

Open robincourant opened 5 months ago

robincourant commented 5 months ago

Hi,

Firstly, thank you very much for your work!

I am curious about how you determine the values of $P{\text{mean}}$ and $P{\text{std}}$ as per the "Loss weighting" paragraph in Section B.2, where it states "Pmean = −0.4 and Pstd = 1.0 instead of −1.2 and 1.2".

Is there an underlying intuition or is it based on a pure hp search?