OpenEnergyPlatform / open-MaStR

A collaborative software to download the energy database Marktstammdatenregister (MaStR)
https://open-mastr.readthedocs.io/en/latest/
GNU Affero General Public License v3.0
88 stars 19 forks source link

Dependency errors (warnings) when installing from source #555

Open nesnoj opened 2 months ago

nesnoj commented 2 months ago

Installing from source with pip install "open_mastr[dev]" as described here (branch: production) raises some install errors:

...
Installing collected packages: verspec, pytz, paginate, distlib, zipp, xmltodict, watchdog, urllib3, tqdm, tomlkit, six, regex, pyyaml, pyparsing, pygments, pyflakes, pycparser, pycodestyle, psycopg2-binary, pluggy, platformdirs, pathspec, packaging, numpy, nodeenv, mypy-extensions, more-itertools, mkdocs-material-extensions, mergedeep, mccabe, MarkupSafe, markdown, lxml, jeepney, isort, iniconfig, importlib-resources, idna, identify, greenlet, filelock, dill, colorama, click, charset-normalizer, cfgv, certifi, bump2version, bracex, backports.tarfile, astroid, wcmatch, virtualenv, sqlalchemy, pyyaml-env-tag, pytest, pymdown-extensions, pylint, mkdocs-get-deps, jinja2, jaraco.functools, jaraco.context, jaraco.classes, isodate, importlib-metadata, griffe, flake8, cffi, black, requests-toolbelt, requests-file, pytest-dependency, pre-commit, pandas, ghp-import, cryptography, zeep, SecretStorage, mkdocs, mkdocs-material, mkdocs-include-markdown-plugin, mkdocs-autorefs, mike, keyring, open_mastr, mkdocstrings, mkdocstrings-python

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
bleach 6.1.0 requires webencodings, which is not installed.
geopandas 0.14.0 requires pyproj>=3.3.0, which is not installed.
ipykernel 6.28.0 requires psutil, which is not installed.
ipython 8.20.0 requires decorator, which is not installed.
ipython 8.20.0 requires pexpect>4.3; sys_platform != "win32", which is not installed.
nbconvert 7.14.0 requires beautifulsoup4, which is not installed.

Successfully installed MarkupSafe-2.1.5 SecretStorage-3.3.3 astroid-3.2.4 backports.tarfile-1.2.0 black-24.8.0 bracex-2.5 bump2version-1.0.1 certifi-2024.7.4 cffi-1.17.0 cfgv-3.4.0 charset-normalizer-3.3.2 click-8.1.7 colorama-0.4.6 cryptography-43.0.0 dill-0.3.8 distlib-0.3.8 filelock-3.15.4 flake8-7.1.1 ghp-import-2.1.0 greenlet-3.0.3 griffe-1.2.0 identify-2.6.0 idna-3.8 importlib-metadata-8.4.0 importlib-resources-6.4.4 iniconfig-2.0.0 isodate-0.6.1 isort-5.13.2 jaraco.classes-3.4.0 jaraco.context-6.0.1 jaraco.functools-4.0.2 jeepney-0.8.0 jinja2-3.1.4 keyring-25.3.0 lxml-5.3.0 markdown-3.7 mccabe-0.7.0 mergedeep-1.3.4 mike-2.1.3 mkdocs-1.6.0 mkdocs-autorefs-1.1.0 mkdocs-get-deps-0.2.0 mkdocs-include-markdown-plugin-6.2.2 mkdocs-material-9.5.33 mkdocs-material-extensions-1.3.1 mkdocstrings-0.25.2 mkdocstrings-python-1.10.8 more-itertools-10.4.0 mypy-extensions-1.0.0 nodeenv-1.9.1 numpy-2.1.0 open_mastr-0.14.4 packaging-24.1 paginate-0.5.7 pandas-2.2.2 pathspec-0.12.1 platformdirs-4.2.2 pluggy-1.5.0 pre-commit-3.8.0 psycopg2-binary-2.9.9 pycodestyle-2.12.1 pycparser-2.22 pyflakes-3.2.0 pygments-2.18.0 pylint-3.2.6 pymdown-extensions-10.9 pyparsing-3.1.4 pytest-8.3.2 pytest-dependency-0.6.0 pytz-2024.1 pyyaml-6.0.2 pyyaml-env-tag-0.1 regex-2024.7.24 requests-file-2.1.0 requests-toolbelt-1.0.0 six-1.16.0 sqlalchemy-2.0.32 tomlkit-0.13.2 tqdm-4.66.5 urllib3-2.2.2 verspec-0.1.0 virtualenv-20.26.3 watchdog-5.0.0 wcmatch-9.0 xmltodict-0.13.0 zeep-4.2.1 zipp-3.20.1
...

However, tool works as expected. The listed packages in the middle were not installed in the env according to conda list. They are not part of any requirements - I triple checked everything: Although they're needed for the files/notebooks in the ./scripts/ dir you would have to install them manually, Also, I don't see any link to the postprocessing/requirements_pp.txt which is the only file containing these packages.

I wonder if this is a bug in my system cache or sth.. If you could spare some minutes, it'd be great if you try to reproduce @FlorianK13 .

PS: I created a low prio tag for this..

FlorianK13 commented 2 months ago

I will look at it within the next weeks. If the postprocessing/requirements_pp.txt is not needed we should take care of it in #552