Free validation tokens/emb after first training run

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

GNU Affero General Public License v3.0

1.44k stars 67 forks source link

Closed congruency closed 1 week ago

congruency commented 1 month ago

Fixes OOM w/ 24GB and bs=12 on 1024px on first run by deleting references to the unused memory after the T5 encoding is saved to disk.

lawrence-cj commented 1 week ago

I have also noticed it. Nice one. Merged