search

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
https://pixart-alpha.github.io/PixArt-sigma-project/
GNU Affero General Public License v3.0
1.47k stars 70 forks source link

accelerator.wait_for_everyone()时机有问题，导致多机多卡训练显卡利用率上不去 #23

Closed conansherry closed 3 months ago

conansherry commented 3 months ago

可以参考 https://github.com/kohya-ss/sd-scripts/blob/71e2c91330a9d866ec05cdd10584bbb962896a99/sdxl_train.py#L651

lawrence-cj commented 3 months ago

Thx so much. Changed. Would you plz help to check if the changes are correct: https://github.com/PixArt-alpha/PixArt-sigma/commit/dc27d4f8e9e64f1770957fe3cad0c45c1e627a4f