search

mindspore-lab / mindone

one for all, Optimal generator with No Exception
Apache License 2.0
328 stars 62 forks source link

[Opensora-PKU] training with optimizer parallel #510

Closed wtomin closed 3 weeks ago

wtomin commented 1 month ago

Training scripts for three-stages. Optimizer parallel:

  1. 17x256x256, bs=4;
  2. 65x256x256, bs=4;
  3. 65x512x512, bs=2; Additionally, 17x512x512(bs=4).