[WIP] OpenSORA-PKU: training and inference

mindspore-lab / mindone

one for all, Optimal generator with No Exception

Apache License 2.0

329 stars 63 forks source link

Closed wtomin closed 4 weeks ago

wtomin commented 2 months ago

With the commits of Jason, the opensora-pku now is supported. This PR includes:

[x] casual vae inference;
[x] causal vae training;
[x] latte t2v inference: the inference results on 910B (ms.2.3.0rc1) are visually fine.
[x] latte t2v training: the training of 17x256x256 and 65x256x256 is verified on ms2.3.0.20240423. FA is enabled.