NVlabs / I2SB

Other
260 stars 23 forks source link

Confused about the sampling algorithm #4

Open Morefre opened 1 year ago

Morefre commented 1 year ago

I understand the theories and how they come up with the algorithm. However, the resulting algorithm is very confusing. Just by looking at the algorithm 1 and 2, what IS2B actually does is training a diffusion model using VE-SDE as in equation (12). The only difference from standard VE-SDE is that they use a different forward process to generate data for training the network as in equation (11). That's it, nothing more.

It's surprising this method will work in practice since the data generation process is different from the defined forward SDE. Will the method still work if we design another data generation process instead of equation (11). Will the method still work if we change equation (12) to the training formula for VP-SDE and change the DDPM posterior formula in algorithm 2 to that of the VP-SDE?

So, basically I don't know how to understand I2SB correctly. Any discussion or correction will be appreciated !

image image image