anandpawara / Real_Time_Image_Animation

The Project is real time application in opencv using first order model
GNU General Public License v3.0
3.23k stars 521 forks source link

How to run? #49

Open piwawa opened 8 months ago

piwawa commented 8 months ago
(rt) root@vultr:~/AIGC/Real_Time_Image_Animation# python ./image_animation.py -i ./Inputs/Monalisa.png -c ./checkpoints/vox-cpk.pth.tar -v ./demo/videos/0.mp4
/root/AIGC/Real_Time_Image_Animation/demo.py:2: UserWarning: 
This call to matplotlib.use() has no effect because the backend has already
been chosen; matplotlib.use() must be called *before* pylab, matplotlib.pyplot,
or matplotlib.backends is imported for the first time.

The backend was *originally* set to 'TkAgg' by the following code:
  File "./image_animation.py", line 4, in <module>
    from animate import normalize_kp
  File "/root/AIGC/Real_Time_Image_Animation/animate.py", line 7, in <module>
    from frames_dataset import PairedDataset
  File "/root/AIGC/Real_Time_Image_Animation/frames_dataset.py", line 2, in <module>
    from skimage import io, img_as_float32
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/__init__.py", line 15, in <module>
    reset_plugins()
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/manage_plugins.py", line 95, in reset_plugins
    _load_preferred_plugins()
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/manage_plugins.py", line 75, in _load_preferred_plugins
    _set_plugin(p_type, preferred_plugins['all'])
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/manage_plugins.py", line 87, in _set_plugin
    use_plugin(plugin, kind=plugin_type)
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/manage_plugins.py", line 258, in use_plugin
    _load(name)
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/manage_plugins.py", line 302, in _load
    fromlist=[modname])
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/io/_plugins/matplotlib_plugin.py", line 4, in <module>
    import matplotlib.pyplot as plt
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/matplotlib/pyplot.py", line 71, in <module>
    from matplotlib.backends import pylab_setup
  File "/root/miniconda3/envs/rt/lib/python3.7/site-packages/matplotlib/backends/__init__.py", line 16, in <module>
    line for line in traceback.format_stack()

  matplotlib.use('Agg')
[INFO] loading source image and checkpoint...
./image_animation.py:29: DeprecationWarning: Starting with ImageIO v3 the behavior of this function will switch to that of iio.v3.imread. To keep the current behavior (and make this warning disappear) use `import imageio.v2 as imageio` or call `imageio.v2.imread` directly.
  source_image = imageio.imread(source_path)
/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/transform/_warps.py:105: UserWarning: The default mode, 'constant', will be changed to 'reflect' in skimage 0.15.
  warn("The default mode, 'constant', will be changed to 'reflect' in "
/root/miniconda3/envs/rt/lib/python3.7/site-packages/skimage/transform/_warps.py:110: UserWarning: Anti-aliasing will be enabled by default in skimage 0.15 to avoid aliasing artifacts when down-sampling images.
  warn("Anti-aliasing will be enabled by default in skimage 0.15 to "
/root/AIGC/Real_Time_Image_Animation/demo.py:27: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
  config = yaml.load(f)
/root/miniconda3/envs/rt/lib/python3.7/site-packages/torch/functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at  ../aten/src/ATen/native/TensorShape.cpp:2894.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
[INFO] Loading video from the given path
/root/miniconda3/envs/rt/lib/python3.7/site-packages/torch/nn/functional.py:4216: UserWarning: Default grid_sample and affine_grid behavior has changed to align_corners=False since 1.3.0. Please specify align_corners=True if the old behavior is desired. See the documentation of grid_sample for details.
  "Default grid_sample and affine_grid behavior has changed "
/root/miniconda3/envs/rt/lib/python3.7/site-packages/torch/nn/functional.py:1960: UserWarning: nn.functional.sigmoid is deprecated. Use torch.sigmoid instead.
  warnings.warn("nn.functional.sigmoid is deprecated. Use torch.sigmoid instead.")
: cannot connect to X server