LTH14 / mar

PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838
MIT License
1.06k stars 59 forks source link

Is it possible to turn DiTs to MAR models? #74

Open huanglianghua opened 3 weeks ago

huanglianghua commented 3 weeks ago

Hi, I am wondering if it is possible to turn existing DiT models (such as SD3 and FLUX), with some finetining, into the MAR + DiffLoss models? Thanks.

LTH14 commented 3 weeks ago

Interesting idea -- I haven't tried that. Sounds worth trying.

Graduo commented 2 weeks ago

Hi, I am wondering if it is possible to turn existing DiT models (such as SD3 and FLUX), with some finetining, into the MAR + DiffLoss models? Thanks.

maskdit https://arxiv.org/pdf/2306.09305 It seems like that