DiT with decorator, triton fused_AdaLN and fineGrained

PaddlePaddle / PaddleMIX

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

Apache License 2.0

238 stars 100 forks source link

DiT with decorator, triton fused_AdaLN and fineGrained #552

Open YKTian-x2b opened 1 month ago

YKTian-x2b commented 1 month ago

DiT with decorator, triton fused_AdaLN and fineGrained ffn+qkv

fp16 speedup +47.12%

paddle-bot[bot] commented 1 month ago

Thanks for your contribution!