Alpha-VLLM / Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation
MIT License
2.09k stars 88 forks source link

About time shifting factor. #31

Open JincanDeng opened 6 months ago

JincanDeng commented 6 months ago

For Lumina-T2I, it seems that time_shifting_factor is only implemented in the ODE integrator, but not in the SDE integrator. Does this factor have a big impact? SDE and ODE, which one is more recommended? Thanks!

zhuole1025 commented 6 months ago

Thanks for your interest! Actually, we only use the ODE for sampling since our model adopts the flow matching formulation, and the SDE integrator is only used for the diffusion formulation. The time shifting factor has a great impact especially when sampling steps are limited (e.g., less than 50 steps).