Installation issue

[richardrl]

Hey, I tried to run the demo script and got this after installing required packages:

pository1.0-dev
c
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
_gtk3_compat.py 29 <module>
import gi

ModuleNotFoundError:
No module named 'gi'

---------------------------------------------------------------------------------------------------------------------------------------------------------------------
_gtk3_compat.py 32 <module>
import pgi as gi

ModuleNotFoundError:
No module named 'pgi'

---------------------------------------------------------------------------------------------------------------------------------------------------------------------
demo_script.py 9 <module>
from main import instantiate_from_config

main.py 6 <module>
import pytorch_lightning as pl

__init__.py 27 <module>
from pytorch_lightning.callbacks import Callback  # noqa: E402

__init__.py 14 <module>
from pytorch_lightning.callbacks.batch_size_finder import BatchSizeFinder

batch_size_finder.py 26 <module>
from pytorch_lightning.callbacks.callback import Callback

callback.py 22 <module>
from pytorch_lightning.utilities.types import STEP_OUTPUT

types.py 41 <module>
from torchmetrics import Metric

__init__.py 26 <module>
from torchmetrics import functional  # noqa: E402

__init__.py 14 <module>
from torchmetrics.functional.audio._deprecated import _permutation_invariant_training as permutation_invariant_training

__init__.py 14 <module>
from torchmetrics.functional.audio.pit import permutation_invariant_training, pit_permutate

pit.py 22 <module>
from torchmetrics.utilities import rank_zero_warn

__init__.py 14 <module>
from torchmetrics.utilities.checks import check_forward_full_state_property

checks.py 25 <module>
from torchmetrics.metric import Metric

metric.py 42 <module>
from torchmetrics.utilities.plot import _AX_TYPE, _PLOT_OUT_TYPE, plot_single_or_multi_val

plot.py 27 <module>
import matplotlib.pyplot as plt

pyplot.py 115 <module>
_backend_mod, new_figure_manager, draw_if_interactive, _show = pylab_setup()

__init__.py 62 pylab_setup
backend_mod = __import__(backend_name, globals(), locals(),

backend_gtk3agg.py 9 <module>
from . import backend_agg, backend_gtk3

backend_gtk3.py 19 <module>
from ._gtk3_compat import GLib, GObject, Gtk, Gdk

_gtk3_compat.py 34 <module>
raise ImportError("The Gtk3 backend requires PyGObject or pgi")

ImportError:
The Gtk3 backend requires PyGObject or pgi

Any idea?

[richardrl]

https://stackoverflow.com/questions/78281985/how-do-install-gst-python-on-macos-to-work-with-the-recommended-gstreamer-instal

This helped

[richardrl]

Can you provide a requirements.txt with all the remaining files that are not in the conda yaml? It's proving very difficult to get the demo script running, I tried installing all the packages without version numbers and there are many conflicts. here's the latest one:

 from torchmetrics.metric import Metric                                                                                                                           
  File "/samsung4tb/conda_envs/agent_inpainting/lib/python3.8/site-packages/torchmetrics/metric.py", line 42, in <module>                                            
    from torchmetrics.utilities.plot import _AX_TYPE, _PLOT_OUT_TYPE, plot_single_or_multi_val
  File "/samsung4tb/conda_envs/agent_inpainting/lib/python3.8/site-packages/torchmetrics/utilities/plot.py", line 26, in <module>
    import matplotlib.axes
  File "/home/rli14/.local/lib/python3.8/site-packages/matplotlib/axes/__init__.py", line 4, in <module>
    from ._subplots import *
  File "/home/rli14/.local/lib/python3.8/site-packages/matplotlib/axes/_subplots.py", line 7, in <module>
    from matplotlib.gridspec import GridSpec, SubplotSpec
  File "/home/rli14/.local/lib/python3.8/site-packages/matplotlib/gridspec.py", line 27, in <module>
    from matplotlib import _pylab_helpers, tight_layout, rcParams
  File "/home/rli14/.local/lib/python3.8/site-packages/matplotlib/tight_layout.py", line 15, in <module>
    from matplotlib.transforms import TransformedBbox, Bbox
  File "/home/rli14/.local/lib/python3.8/site-packages/matplotlib/transforms.py", line 42, in <module>
    from matplotlib._path import (affine_transform, count_bboxes_overlapping_bbox,
ImportError: numpy.core.multiarray failed to import

[MatthewChang]

I just did a clean install following the instructions in the readme using conda 24.3.0 on Ubuntu 20.04. I had to make one change to the environment.yaml to add the conda-forge channel so that the cudatoolkit could be found. (I've just pushed this change to the repo). The demo script worked for me after running conda env create -f environment.yaml, activating the environment conda activate vidm, and downloading the weights.

My install produced the following pip requirements:

absl-py==2.1.0
aiohttp==3.9.5
aiosignal==1.3.1
albumentations==0.4.3
altair==5.3.0
antlr4-python3-runtime==4.8
async-timeout==4.0.3
attrs==23.2.0
blinker==1.8.2
cachetools==5.3.3
certifi==2024.2.2
charset-normalizer==3.3.2
click==8.1.7
cloudpickle==3.0.0
einops==0.3.0
filelock==3.14.0
frozenlist==1.4.1
fsspec==2024.3.1
funcy==1.18
future==1.0.0
gitdb==4.0.11
GitPython==3.1.43
google-auth==2.29.0
google-auth-oauthlib==1.0.0
grpcio==1.63.0
gym==0.23.0
gym-notices==0.0.8
h5py==3.7.0
huggingface-hub==0.23.0
hydra-core==1.3.2
idna==3.7
imageio==2.9.0
imageio-ffmpeg==0.4.2
imgaug==0.2.6
importlib-metadata==7.1.0
importlib-resources==6.4.0
jinja2==3.1.4
jsonschema==4.22.0
jsonschema-specifications==2023.12.1
lazy-loader==0.4
llvmlite==0.41.1
Markdown==3.6
markdown-it-py==3.0.0
MarkupSafe==2.1.5
mdurl==0.1.2
multidict==6.0.5
networkx==3.1
numba==0.58.1
numpy==1.24.4
numpy-quaternion==2023.0.3
nvidia-cublas-cu11==11.10.3.66
nvidia-cuda-nvrtc-cu11==11.7.99
nvidia-cuda-runtime-cu11==11.7.99
nvidia-cudnn-cu11==8.5.0.96
oauthlib==3.2.2
omegaconf==2.1.1
opencv-python==4.1.2.30
packaging==24.0
pandas==2.0.3
pillow==10.3.0
pkgutil-resolve-name==1.3.10
protobuf==4.25.3
pudb==2019.2
pyarrow==16.0.0
pyasn1==0.6.0
pyasn1-modules==0.4.0
pydeck==0.9.1
pyDeprecate==0.3.1
pygments==2.18.0
python-dateutil==2.9.0.post0
pytorch-lightning==1.4.2
pytz==2024.1
PyWavelets==1.4.1
PyYAML==6.0.1
referencing==0.35.1
regex==2024.5.10
requests==2.31.0
requests-oauthlib==2.0.0
rich==13.7.1
rpds-py==0.18.1
rsa==4.9
scikit-image==0.20.0
scipy==1.9.1
six==1.16.0
smmap==5.0.1
streamlit==1.34.0
-e git+https://github.com/CompVis/taming-transformers.git@3ba01b241669f5ade541ce990f7650a3b8f65318#egg=taming_transformers
tenacity==8.3.0
tensorboard==2.14.0
tensorboard-data-server==0.7.2
test-tube==0.7.5
tifffile==2023.7.10
tokenizers==0.12.1
toml==0.10.2
toolz==0.12.1
torch==1.13.1
torch-fidelity==0.3.0
torchmetrics==0.6.0
torchvision==0.14.1
tornado==6.4
tqdm==4.66.2
transformers==4.19.2
typing-extensions==4.11.0
tzdata==2024.1
urllib3==2.2.1
urwid==2.6.11
-e git+git@github.com:MatthewChang/agent_inpainting.git@9f54c98d6e4ab4df632bd46ab99062237b43115d#egg=vidm
watchdog==4.0.0
wcwidth==0.2.13
werkzeug==3.0.3
yarl==1.9.4
zipp==3.18.1

I hope this helps.