DinoMan / speech-driven-animation

949 stars 289 forks source link

your code is not working #72

Open csp021 opened 1 year ago

csp021 commented 1 year ago

I was trying this on Colab. Getting an error on pickling. Can you pls help on this? Thanks

Below code:

!pip install ffmpeg !pip install face-alignment !pip install sk-video !pip install sentence_transformers !git clone https://github.com/DinoMan/speech-driven-animation
cd speech-driven-animation !pip install . import sda import scipy.io.wavfile as wav from PIL import Image

va = sda.VideoAnimator(gpu=0) # Instantiate the animator fs, audio_clip = wav.read("example/audio.wav") still_frame = Image.open("example/image.bmp") vid, aud = va(frame, audio_clip, fs=fs)

Getting below error:

UnpicklingError Traceback (most recent call last) in <cell line: 5>() 3 from PIL import Image 4 ----> 5 va = sda.VideoAnimator(gpu=0) # Instantiate the animator 6 fs, audio_clip = wav.read("example/audio.wav") 7 still_frame = Image.open("example/image.bmp")

2 frames /usr/local/lib/python3.10/dist-packages/torch/serialization.py in _legacy_load(f, map_location, pickle_module, pickle_load_args) 1031 "functionality.") 1032 -> 1033 magic_number = pickle_module.load(f, pickle_load_args) 1034 if magic_number != MAGIC_NUMBER: 1035 raise RuntimeError("Invalid magic number; corrupt file?")

UnpicklingError: invalid load key, 'v'.

Hzyhaha commented 6 months ago

Please read the README.md. You need to download the model(s).

Downloading the models

The models were hosted on git LFS. However the demand was so high that I reached the quota for free gitLFS storage. I have moved the models to GoogleDrive. Models can be found here. Place the model file(s) under sda/data/