hpcaitech / Open-Sora

Open-Sora: Democratizing Efficient Video Production for All
https://hpcaitech.github.io/Open-Sora/
Apache License 2.0
20.23k stars 1.91k forks source link

how to load opensorav1.2 model weights? #496

Closed Lexarymade closed 2 weeks ago

Lexarymade commented 2 weeks ago

I've already downloaded the vae and the stdit3 model weight from huggingface to my device. How can I load the downloaded model in the code instead of downloading from huggingface hpcaitech/Open-Sora?

I can load the T5, but fail to load the vae and the stdit3

catsled commented 2 weeks ago

image

modify from_pretrained in inference/sample.py

zhengzangw commented 2 weeks ago

Yes, try pull the latest code and replace the path in the from_pretrained in configs/opensora-v1-2/inference/sample.py.

Lexarymade commented 2 weeks ago

commented

i will try, thx!

liuxi0099 commented 2 weeks ago

Yes, try pull the latest code and replace the path in the from_pretrained in configs/opensora-v1-2/inference/sample.py.

Do you mean line 18, 26, 33? 屏幕截图 2024-06-20 222308

zhengzangw commented 2 weeks ago

Yes.

Lexarymade commented 2 weeks ago

now I face following error: OSError: PixArt-alpha/pixart_sigma_sdxlvae_T5_diffusers does not appear to have a file named config.json. how to fix this ?

zhengzangw commented 2 weeks ago

See #525