Huage001 / LinFusion

Official PyTorch and Diffusers Implementation of "LinFusion: 1 GPU, 1 Minute, 16K Image"
Apache License 2.0
237 stars 16 forks source link

will support pixart-sigma ? #5

Open kelisiya opened 1 month ago

Huage001 commented 1 month ago

Thanks for your question. We are actively exploring the application on Diffusion Transformer based models. We will update this repo if there is any progress!

IPv6 commented 1 month ago

Or may be Flux? Since it is a distillation into more robust/memory-relaxed form.

Anyway, idea to research alternative attention mechanics sounds interesting, congrats!