search

hpcaitech / Open-Sora

Open-Sora: Democratizing Efficient Video Production for All
https://hpcaitech.github.io/Open-Sora/
Apache License 2.0
20.77k stars 1.97k forks source link

is the text/vae frozen? #425

Closed bio-mlhui closed 4 weeks ago

bio-mlhui commented 1 month ago

I see that the ckpt only provides DiT weights. Does this mean the text/vae are frozen during training? Are you preparing to release a fully-trained model?

JThh commented 1 month ago

Can @zhengzangw please take a look?

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 7 days with no activity.

zhengzangw commented 4 weeks ago

During training, the text & vae is frozen as they are only tokenizers.

For Open-Sora 1.2, we release a trained VAE.