search

sail-sg / FDM

The official PyTorch implementation of Fast Diffusion Model
Apache License 2.0
91 stars 5 forks source link

Difference between FDM and EDM. #3

Open GuHuangAI opened 10 months ago

GuHuangAI commented 10 months ago

Hello, thanks to your sharing the codes. I have read some codes and I find the difference between FDM and EDM is the loss function. Have you modified any other codes of EDM?

GuHuangAI commented 10 months ago

I find another difference is c_in.

nickwzk commented 8 months ago

Hi @GuHuangAI, Thank you for your interest in our work. The difference in c_in is the most crucial modification, as it replace the vanilla diffusion process by our proposed momentum-based diffusion process. Please check the Table 1 in our paper for detail.

GuHuangAI commented 8 months ago

Hi @GuHuangAI, Thank you for your interest in our work. The difference in c_in is the most crucial modification, as it replace the vanilla diffusion process by our proposed momentum-based diffusion process. Please check the Table 1 in our paper for detail.

Thanks for your kind reply. In my experiments, the precondition of EDM seems to be not important. I have tried to add the loss function of FDM, which clamps the weights, but the results are not satisfactory.