Tencent / MimicMotion

High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance
https://tencent.github.io/MimicMotion/
Other
1.68k stars 138 forks source link

Error in loading model configuration from Hugging Face Hub: HFValidationError in inference.py #5

Closed vrgamegirl19 closed 3 months ago

vrgamegirl19 commented 3 months ago

Issue Summary

Encountered an error while running inference.py related to loading model configuration from Hugging Face Hub.

Error Details

Traceback (most recent call last):
  File "C:\Users\pyro1\Miniconda3\envs\mimicmotion\Lib\site-packages\diffusers\configuration_utils.py", line 380, in load_config
    config_file = hf_hub_download(
                  ^^^^^^^^^^^^^^^^
  File "C:\Users\pyro1\Miniconda3\envs\mimicmotion\Lib\site-packages\huggingface_hub\utils\_validators.py", line 106, in _inner_fn
    validate_repo_id(arg_value)
  File "C:\Users\pyro1\Miniconda3\envs\mimicmotion\Lib\site-packages\huggingface_hub\utils\_validators.py", line 154, in validate_repo_id
    raise HFValidationError(
huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': 'models/SVD/stable-video-diffusion-img2vid-xt-1-1'. Use `repo_type` argument if needed.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "E:\NewMimicMotion\MimicMotion\inference.py", line 134, in <module>
    main(args)
  File "C:\Users\pyro1\Miniconda3\envs\mimicmotion\Lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "E:\NewMimicMotion\MimicMotion\inference.py", line 89, in main
    pipeline = create_pipeline(infer_config, device)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\NewMimicMotion\MimicMotion\mimicmotion\utils\loader.py", line 42, in create_pipeline
    mimicmotion_models = MimicMotionModel(infer_config.base_model_path).to(device=device).eval()
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\NewMimicMotion\MimicMotion\mimicmotion\utils\loader.py", line 23, in __init__
    UNetSpatioTemporalConditionModel.load_config(base_model_path, subfolder="unet"))
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\pyro1\Miniconda3\envs\mimicmotion\Lib\site-packages\huggingface_hub\utils\_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "C:\Users\pyro1\Miniconda3\envs\mimicmotion\Lib\site-packages\diffusers\configuration_utils.py", line 415, in load_config
    raise EnvironmentError(
OSError: We couldn't connect to 'https://huggingface.co' to load this model, couldn't find it in the cached files and it looks like models/SVD/stable-video-diffusion-img2vid-xt-1-1 is not the path to a directory containing a config.json file.
Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/diffusers/installation#offline-mode'.

Steps to Reproduce

Set up environment as described. Run inference.py script.

Expected Behavior

Model configuration should load without errors.

Actual Behavior

An HFValidationError occurs when attempting to validate the repository ID.

Environment OS: Win 11 Python version: 3.11.9 Diffusers version: 0.27.0

gujiaxi commented 3 months ago

You can check if the pre-trained model files exist in models/SVD/stable-video-diffusion-img2vid-xt-1-1/. If it doesn't, you can follow the instructions to download model weights.

vrgamegirl19 commented 3 months ago

You can check if the pre-trained model files exist in models/SVD/stable-video-diffusion-img2vid-xt-1-1/. If it doesn't, you can follow the instructions to download model weights.

The model file is there. What other files are needed? Could I be missing a configuration file?

vrgamegirl19 commented 3 months ago

My model file was corrupt and i was missing a few other files. I'm getting closer at getting this to work. at least past this issue.