search

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
https://pixart-alpha.github.io/PixArt-sigma-project/
GNU Affero General Public License v3.0
1.47k stars 70 forks source link

2K model do not use kv_compress? #131

Open luoyuxuan0528 opened 1 week ago

luoyuxuan0528 commented 1 week ago

@lawrence-cj , hi I try to use the 2k model but find a strange issue: why kv_compress is set to false in 2k model but set to true in 1k model? Is this a typo? https://github.com/PixArt-alpha/PixArt-sigma/blob/ea0ad69864a3617e5d61f060ee8fa081f2cd65b1/configs/pixart_sigma_config/PixArt_sigma_xl2_img2K_internalms_kvcompress.py#L44

https://github.com/PixArt-alpha/PixArt-sigma/blob/ea0ad69864a3617e5d61f060ee8fa081f2cd65b1/configs/pixart_sigma_config/PixArt_sigma_xl2_img1024_internalms_kvcompress.py#L44