train speed seems too slow

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

GNU Affero General Public License v3.0

1.44k stars 68 forks source link

Closed Hazarch closed 2 months ago

Hazarch commented 2 months ago

On A800 80G, seting train_batch_size = 20, it seems consume 6 mins using fp16. 1123

lawrence-cj commented 2 months ago

I would suggest you to pre-compute all the T5 and VAE features in advance for fast training.