Question about KV compression in diffusers

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

GNU Affero General Public License v3.0

1.44k stars 68 forks source link

Closed lijing1996 closed 2 months ago

lijing1996 commented 2 months ago

I saw diffusers_patches.py. However, I don't know where is the KV compression and how can I use this py file? Could you help me? Thanks.

lawrence-cj commented 2 months ago

KV compression ckpt is not released yet. The diffusers_patches.py is used in diffusers: https://github.com/PixArt-alpha/PixArt-sigma?tab=readme-ov-file#2-integration-in-diffusers