search

hpcaitech / Open-Sora

Open-Sora: Democratizing Efficient Video Production for All
https://hpcaitech.github.io/Open-Sora/
Apache License 2.0
20.34k stars 1.92k forks source link

PixArt-alpha/pixart_sigma_sdxlvae_T5_diffusers in opensora v1.2 #459

Closed Edwardmark closed 2 weeks ago

Edwardmark commented 2 weeks ago

I have downloaded the new vae and stdit model from hugging face and change the config in sample.py, but when run the code errors shows: File "Open-Sora/opensora/models/vae/vae.py", line 284, in OpenSoraVAE_V1_2 model = VideoAutoencoderPipeline(config) File "Open-Sora/opensora/models/vae/vae.py", line 154, in init self.spatial_vae = build_module(config.vae_2d, MODELS) File "Open-Sora/opensora/registry.py", line 24, in build_module return builder.build(cfg) File "/root/miniconda3/envs/opensora_v1.1/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build return self.build_func(cfg, args, kwargs, registry=self) File "/root/miniconda3/envs/opensora_v1.1/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg obj = obj_cls(args) # type: ignore File "Open-Sora/opensora/models/vae/vae.py", line 19, in init self.module = AutoencoderKL.from_pretrained( File "/root/miniconda3/envs/opensora_v1.1/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(args, *kwargs) File "/root/miniconda3/envs/opensora_v1.1/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 567, in from_pretrained config, unused_kwargs, commit_hash = cls.load_config( File "/root/miniconda3/envs/opensora_v1.1/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(args, **kwargs) File "/root/miniconda3/envs/opensora_v1.1/lib/python3.10/site-packages/diffusers/configuration_utils.py", line 406, in load_config raise EnvironmentError( OSError: PixArt-alpha/pixart_sigma_sdxlvae_T5_diffusers does not appear to have a file named config.json.

liiiiiiiiil commented 2 weeks ago

same error

zoumaguanxin commented 2 weeks ago

same error too

hadipash commented 2 weeks ago

rename vae_config.json to config.json under pixart_sigma_sdxlvae_T5_diffusers/vae

zhengzangw commented 2 weeks ago

After testing, in our case, we find this problem only happens when you can no access to huggingface.com (e.g., mainland China). A quick fix is:

export HF_ENDPOINT=https://hf-mirror.com

Then you can successfully download from huggingface.

zhengzangw commented 2 weeks ago

moved to #525.