search

MyNiuuu / MOFA-Video

[ECCV 2024] MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model.
https://myniuuu.github.io/MOFA_Video
Other
626 stars 35 forks source link

trying to set-up #9

Closed RomeroRZ closed 4 months ago

RomeroRZ commented 5 months ago

Hi, thanks for this wonderful code !

I'm getting issues to install it, tried to follow the folder logic image

(cupyenv) PS E:\MOFA-Video-main\MOFA-Video-main\MOFA-Video-Traj> python run_gradio.py start loading models... IMPORTANT: You are using gradio version 4.5.0, however version 4.29.0 is available, please upgrade.

Traceback (most recent call last): File "run_gradio.py", line 655, in DragNUWA_net = Drag("cuda:0", target_size, target_size, 25) File "run_gradio.py", line 225, in init self.pipeline, self.cmp = init_models( File "run_gradio.py", line 101, in init_models vae = AutoencoderKLTemporalDecoder.from_pretrained( File "C:\Users\aravi.conda\envs\cupyenv\lib\site-packages\diffusers\models\modeling_utils.py", line 712, in from_pretrained config, unused_kwargs, commit_hash = cls.load_config( File "C:\Users\aravi.conda\envs\cupyenv\lib\site-packages\diffusers\configuration_utils.py", line 365, in load_config raise EnvironmentError( OSError: Error no file named config.json found in directory ckpts/stable-video-diffusion-img2vid-xt-1-1.

i can't find any config.json for the stable-video-diffusion-img2vid-xt-1-1

I downloaded file by files from huggingface the diffuser but maybe it needs to be done in a more convenient way ?

thanks in advance !

MyNiuuu commented 5 months ago

Do you have a config.json file in the .ckpts/stable-video-diffusion-img2vid-xt-1-1/vae directory? I suspect the absence of config.json in .ckpts/stable-video-diffusion-img2vid-xt-1-1/vae is causing this error, as it seems to stem from the line initializing the VAE.