JulianGuerreiro / LayoutFlow

LayoutFlow: Flow Matching for Layout Generation [Andrade Guerreiro et al., ECCV 2024]
https://julianguerreiro.github.io/layoutflow
MIT License
20 stars 3 forks source link

Is DLTbackbone model ready to be used? #3

Open jundaz opened 2 hours ago

jundaz commented 2 hours ago

Hello there, Really appreciate the comprehensive code you implemented, there are 2 things i want to confirm: Is the layoutdmx you included the same as the the original layoutdm? If not what is the change made here? I see that included DLT as in backbone model as well, is it the same as the original DLT model and is it ready to be used? If yes, can I simply use it by changing backbone model in config file? is there anything else I need to change? Thank you very much!

JulianGuerreiro commented 2 hours ago

Hi, thank you for your message!

Both LayoutDM and DLT backbones are not the original models but use the same or a very similar transformer architecture as these methods. For the results in our paper, we used the LayoutDM backbone architecture but the results we got using the DLT backbone were actually quite similar and only slightly worse. To be clear here, the training procedure and other settings are quite different from DLT and LayoutDM, this is only the architecture blocks of the models that are similar.

Regarding LayoutDMx, I'm sorry the name is a little unfortunate here. LayoutDMx has not a lot to do with LayoutDM (which uses discrete diffusion). LayoutDMx implements continuous diffusion and we implemented it to directly compare continuous diffusion with continuous flow matching.

In summary, LayoutDMx and LayoutFlow describe the training procedure (diffusion and flow matching, respectively), while the backbones only define the transformer architecture that is used for each denoising step.

jundaz commented 24 minutes ago

I see, so just want to confirm are the results in your paper obtained using the original implementation of DLT and layoutDM (also layoutdiffusion)?