Which Python version are you supporting?

[zerothi]

There are issues trying to install the requirements.txt for 3.10 and 3.11?

[ryanzhangfan]

Thank you for raising this concern. In our environment, we are currently using Python 3.10.12, and we have not encountered any issues with installing the packages listed in the requirements.txt.

If you're facing difficulties in installing the required packages, it might be helpful to provide more details about the specific errors you're encountering.

[zerothi]

Ok, thanks! I'll get back with a bit more details once they are collected :)

[zerothi]

The problem we have is that the resolution of the packages does not work:

With python3/3.10.12

pip._vendor.resolvelib.resolvers.ResolutionTooDeep: 2000000
WARNING: You are using pip version 21.1; however, version 24.0 is available.

it tries to resolve the packages in the requirements.txt file, but after 300+ minutes, it fails. We will try again with an updated pip (24) to see if that might help.

Note, this is in a clean environment, on ALMA 9 with a Hopper GPU and an EPYC 9354 CPU. If you need more info, let me know.

[ryanzhangfan]

We have not met this error before. But I tried to install a new miniconda and directly executing pip install -r requirements.txt just now. Everything goes well and all pkgs in requirements.txt are installed successfully.

[zerothi]

Could you list a pip freeze for us to check? Then we can probably more easily figure out what is causing it on our end (if 24 is not solving it, which it doesn't seem like its doing... )

[ryanzhangfan]

accelerate==0.25.0
aiofiles==23.2.1
aiohttp==3.9.3
aiosignal==1.3.1
altair==5.2.0
annotated-types==0.6.0
anyio==4.3.0
archspec @ file:///croot/archspec_1697725767277/work
async-timeout==4.0.3
attrs==23.2.0
boltons @ file:///croot/boltons_1677628692245/work
Brotli @ file:///tmp/abs_ecyw11_7ze/croots/recipe/brotli-split_1659616059936/work
certifi @ file:///croot/certifi_1707229174982/work/certifi
cffi @ file:///croot/cffi_1700254295673/work
charset-normalizer @ file:///tmp/build/80754af9/charset-normalizer_1630003229654/work
click==8.1.7
conda @ file:///croot/conda_1708369113911/work
conda-content-trust @ file:///croot/conda-content-trust_1693490622020/work
conda-libmamba-solver @ file:///croot/conda-libmamba-solver_1706733287605/work/src
conda-package-handling @ file:///croot/conda-package-handling_1690999929514/work
conda_package_streaming @ file:///croot/conda-package-streaming_1690987966409/work
contourpy==1.2.0
cryptography @ file:///croot/cryptography_1707523700518/work
cycler==0.12.1
decord==0.6.0
diffusers==0.24.0
distro @ file:///croot/distro_1701455004953/work
einops==0.7.0
exceptiongroup==1.2.0
fastapi==0.110.0
ffmpy==0.3.2
filelock==3.13.1
fonttools==4.49.0
frozenlist==1.4.1
fsspec==2024.2.0
gradio==3.40.1
gradio_client==0.11.0
h11==0.14.0
httpcore==1.0.4
httpx==0.27.0
huggingface-hub==0.21.3
idna @ file:///croot/idna_1666125576474/work
importlib-metadata==7.0.1
importlib_resources==6.1.2
Jinja2==3.1.3
jsonpatch @ file:///tmp/build/80754af9/jsonpatch_1615747632069/work
jsonpointer==2.1
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
kiwisolver==1.4.5
libmambapy @ file:///croot/mamba-split_1704219408234/work/libmambapy
linkify-it-py==2.0.3
markdown-it-py==2.2.0
MarkupSafe==2.1.5
matplotlib==3.8.3
mdit-py-plugins==0.3.3
mdurl==0.1.2
menuinst @ file:///croot/menuinst_1706732933928/work
mpmath==1.3.0
multidict==6.0.5
networkx==3.2.1
numpy==1.26.4
nvidia-cublas-cu12==12.1.3.1
nvidia-cuda-cupti-cu12==12.1.105
nvidia-cuda-nvrtc-cu12==12.1.105
nvidia-cuda-runtime-cu12==12.1.105
nvidia-cudnn-cu12==8.9.2.26
nvidia-cufft-cu12==11.0.2.54
nvidia-curand-cu12==10.3.2.106
nvidia-cusolver-cu12==11.4.5.107
nvidia-cusparse-cu12==12.1.0.106
nvidia-nccl-cu12==2.19.3
nvidia-nvjitlink-cu12==12.4.99
nvidia-nvtx-cu12==12.1.105
orjson==3.9.15
packaging @ file:///croot/packaging_1693575174725/work
pandas==2.2.1
peft==0.9.0
pillow==10.2.0
platformdirs @ file:///croot/platformdirs_1692205439124/work
pluggy @ file:///tmp/build/80754af9/pluggy_1648024709248/work
psutil==5.9.8
pycosat @ file:///croot/pycosat_1696536503704/work
pycparser @ file:///tmp/build/80754af9/pycparser_1636541352034/work
pydantic==2.6.3
pydantic_core==2.16.3
pydub==0.25.1
pyparsing==3.1.2
PySocks @ file:///home/builder/ci_310/pysocks_1640793678128/work
python-dateutil==2.9.0.post0
python-multipart==0.0.9
pytz==2024.1
PyYAML==6.0.1
referencing==0.33.0
regex==2023.12.25
requests @ file:///croot/requests_1707355572290/work
rpds-py==0.18.0
ruamel.yaml @ file:///croot/ruamel.yaml_1666304550667/work
ruamel.yaml.clib @ file:///croot/ruamel.yaml.clib_1666302247304/work
safetensors==0.4.2
semantic-version==2.10.0
sentencepiece==0.1.99
six==1.16.0
sniffio==1.3.1
starlette==0.36.3
sympy==1.12
timm==0.9.16
tokenizers==0.13.3
toolz==0.12.1
torch==2.2.0
torchvision==0.17.0
tqdm @ file:///croot/tqdm_1679561862951/work
transformers==4.31.0
triton==2.2.0
truststore @ file:///croot/truststore_1695244293384/work
typing_extensions==4.10.0
tzdata==2024.1
uc-micro-py==1.0.3
urllib3 @ file:///croot/urllib3_1707770551213/work
uvicorn==0.27.1
websockets==11.0.3
xformers==0.0.24
yarl==1.9.4
zipp==3.17.0
zstandard @ file:///croot/zstandard_1677013143055/work

[zerothi]

thanks, we'll have a look!