black-forest-labs / flux

Official inference repo for FLUX.1 models
Apache License 2.0
16.17k stars 1.17k forks source link

Why FLUX VAE is hard to learn on? #189

Open Luciennnnnnn opened 2 weeks ago

Luciennnnnnn commented 2 weeks ago

In DC-AE paper, I observed that the performance using FLUX's VAE was notably inferior. When comparing FLUX VAE and Stable Diffusion 1.5 VAE in my experiment, I found consistent results with the paper - FLUX VAE exhibited significantly slower convergence rates and bad performance compared to SD1.5 VAE.

Has anyone encountered similar issues or can explain the underlying reasons for this performance difference?