NVlabs / I2SB

Other
225 stars 20 forks source link

Confused about the sampling algorithm #4

Open Morefre opened 11 months ago

Morefre commented 11 months ago

I understand the theories and how they come up with the algorithm. However, the resulting algorithm is very confusing. Just by looking at the algorithm 1 and 2, what IS2B actually does is training a diffusion model using VE-SDE as in equation (12). The only difference from standard VE-SDE is that they use a different forward process to generate data for training the network as in equation (11). That's it, nothing more.

It's surprising this method will work in practice since the data generation process is different from the defined forward SDE. Will the method still work if we design another data generation process instead of equation (11). Will the method still work if we change equation (12) to the training formula for VP-SDE and change the DDPM posterior formula in algorithm 2 to that of the VP-SDE?

So, basically I don't know how to understand I2SB correctly. Any discussion or correction will be appreciated !

image image image