Open csp021 opened 1 year ago
Please read the README.md. You need to download the model(s).
The models were hosted on git LFS. However the demand was so high that I reached the quota for free gitLFS storage. I have moved the models to GoogleDrive. Models can be found here.
Place the model file(s) under sda/data/
I was trying this on Colab. Getting an error on pickling. Can you pls help on this? Thanks
Below code:
!pip install ffmpeg !pip install face-alignment !pip install sk-video !pip install sentence_transformers !git clone https://github.com/DinoMan/speech-driven-animation
cd speech-driven-animation !pip install . import sda import scipy.io.wavfile as wav from PIL import Image
va = sda.VideoAnimator(gpu=0) # Instantiate the animator fs, audio_clip = wav.read("example/audio.wav") still_frame = Image.open("example/image.bmp") vid, aud = va(frame, audio_clip, fs=fs)
Getting below error:
UnpicklingError Traceback (most recent call last) in <cell line: 5>()
3 from PIL import Image
4
----> 5 va = sda.VideoAnimator(gpu=0) # Instantiate the animator
6 fs, audio_clip = wav.read("example/audio.wav")
7 still_frame = Image.open("example/image.bmp")
2 frames /usr/local/lib/python3.10/dist-packages/torch/serialization.py in _legacy_load(f, map_location, pickle_module, pickle_load_args) 1031 "functionality.") 1032 -> 1033 magic_number = pickle_module.load(f, pickle_load_args) 1034 if magic_number != MAGIC_NUMBER: 1035 raise RuntimeError("Invalid magic number; corrupt file?")
UnpicklingError: invalid load key, 'v'.