Was a pre-trained model used for opensora-v1-1 training?

hpcaitech / Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

https://hpcaitech.github.io/Open-Sora/

Apache License 2.0

21.77k stars 2.11k forks source link

Was a pre-trained model used for opensora-v1-1 training? #399

Closed Darius-H closed 4 months ago

Darius-H commented 4 months ago

I noticed that in report01.md it mentions “We initialize our model with PixArt-α and initialize the projection layer of inserted temporal attention with zero.” However in the report02.md there is no mention of this item. Also configs/openrosa-v1-1/stage1.py model.from_pretrained=None. Could it be that opensora-v1-1 is randomly initialized? Or is opensora-v1-1 using a pretrained model from opensora-1 ?

github-actions[bot] commented 4 months ago

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] commented 4 months ago

This issue was closed because it has been inactive for 7 days since being marked as stale.