search

clinicalml / co-llm

Co-LLM: Learning to Decode Collaboratively with Multiple Language Models
https://arxiv.org/abs/2403.03870
86 stars 7 forks source link

package version conflict #7

Closed Gabriellamin closed 1 month ago

Gabriellamin commented 2 months ago

Hi, when I install packages via "pip install -r requirements.txt", it gives the following error. It seems caused by package dependency conflicts. When I try to install these packages one by one, it still suffers from the version conflicts. I notice that some packages lack the specific version, such as datasets, huggingface-hub. Could you give the specific version of all packages rather than >= or no version? Thank you so much!

Collecting git+https://github.com/yizhongw/transformers.git@left_padding (from -r requirements_new.txt (line 14))
  Cloning https://github.com/yizhongw/transformers.git (to revision left_padding) to /tmp/pip-req-build-6epb5ow_
  Running command git clone --filter=blob:none --quiet https://github.com/yizhongw/transformers.git /tmp/pip-req-build-6epb5ow_
  Running command git checkout -b left_padding --track origin/left_padding
  Switched to a new branch 'left_padding'
  Branch 'left_padding' set up to track remote branch 'left_padding' from 'origin'.
  Resolved https://github.com/yizhongw/transformers.git to commit fb2b3302c67915c40a2b4fb6711b7b5c5a8bb2a8
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: torch in /home/ubuntu/anaconda3/envs/co-llm-v2/lib/python3.11/site-packages (from -r requirements_new.txt (line 1)) (2.1.0)
Collecting sentencepiece (from -r requirements_new.txt (line 2))
  Using cached sentencepiece-0.2.0.tar.gz (2.6 MB)
  Preparing metadata (setup.py) ... done
Collecting datasets (from -r requirements_new.txt (line 3))
  Using cached datasets-2.19.2.tar.gz (2.2 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Collecting deepspeed>=0.10.0 (from -r requirements_new.txt (line 4))
  Using cached deepspeed-0.14.2-py3-none-any.whl
Collecting accelerate<0.23.0,>=0.21.0 (from -r requirements_new.txt (line 5))
  Using cached accelerate-0.22.0.tar.gz (241 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Collecting peft>=0.4.0 (from -r requirements_new.txt (line 6))
  Using cached peft-0.11.1.tar.gz (262 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Collecting bitsandbytes>=0.41.1 (from -r requirements_new.txt (line 7))
  Using cached bitsandbytes-0.42.0.tar.gz (103.2 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting evaluate>=0.4.0 (from -r requirements_new.txt (line 8))
  Using cached evaluate-0.4.2.tar.gz (65 kB)
  Preparing metadata (setup.py) ... done
Collecting tokenizers>=0.13.3 (from -r requirements_new.txt (line 9))
  Using cached tokenizers-0.19.1.tar.gz (321 kB)
  Installing build dependencies ... error
  error: subprocess-exited-with-error

  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [57 lines of output]
      Collecting maturin<2.0,>=1.0
        Using cached maturin-1.6.0.tar.gz (187 kB)
        Installing build dependencies: started
        Installing build dependencies: finished with status 'done'
        Getting requirements to build wheel: started
        Getting requirements to build wheel: finished with status 'done'
        Preparing metadata (pyproject.toml): started
        Preparing metadata (pyproject.toml): finished with status 'done'
      Building wheels for collected packages: maturin
        Building wheel for maturin (pyproject.toml): started
        Building wheel for maturin (pyproject.toml): finished with status 'error'
        error: subprocess-exited-with-error

        × Building wheel for maturin (pyproject.toml) did not run successfully.
        │ exit code: 1
        ╰─> [35 lines of output]
            /tmp/pip-build-env-lt9x3nmx/overlay/lib/python3.11/site-packages/setuptools/config/_apply_pyprojecttoml.py:83: SetuptoolsWarning: `install_requires` overwritten in `pyproject.toml` (dependencies)
              corresp(dist, value, root_dir)
            running bdist_wheel
            running build
            running build_py
            creating build
            creating build/lib.linux-x86_64-cpython-311
            creating build/lib.linux-x86_64-cpython-311/maturin
            copying maturin/__main__.py -> build/lib.linux-x86_64-cpython-311/maturin
            copying maturin/import_hook.py -> build/lib.linux-x86_64-cpython-311/maturin
            copying maturin/__init__.py -> build/lib.linux-x86_64-cpython-311/maturin
            running egg_info
            creating maturin.egg-info
            writing maturin.egg-info/PKG-INFO
            writing dependency_links to maturin.egg-info/dependency_links.txt
            writing requirements to maturin.egg-info/requires.txt
            writing top-level names to maturin.egg-info/top_level.txt
            writing manifest file 'maturin.egg-info/SOURCES.txt'
            reading manifest file 'maturin.egg-info/SOURCES.txt'
            reading manifest template 'MANIFEST.in'
            warning: no files found matching '*.json' under directory 'src/python_interpreter'
            writing manifest file 'maturin.egg-info/SOURCES.txt'
            running build_ext
            running build_rust
            error: can't find Rust compiler

            If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.

            To update pip, run:

                pip install --upgrade pip

            and then retry package installation.

            If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
            [end of output]

        note: This error originates from a subprocess, and is likely not a problem with pip.
        ERROR: Failed building wheel for maturin
      Failed to build maturin
      ERROR: Could not build wheels for maturin, which is required to install pyproject.toml-based projects
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
lolipopshock commented 2 months ago

Yeah unsurprisingly some package has been updated and that breaks the installation... here is the installed version for the package on my side for your reference for debugging: 

scikit-learn: 1.4.1.post1
torch: 2.1.2
scipy: 1.12.0
packaging: 23.2
sentencepiece: 0.2.0
datasets: 2.14.7
deepspeed: 0.13.4
accelerate: 0.22.0
peft: 0.9.0
bitsandbytes: 0.42.0
evaluate: 0.4.1
tokenizers: 0.15.2
protobuf: 4.25.3
seaborn: 0.13.2
vllm: 0.3.3
rouge_score: 0.1.2
tensorboard: 2.16.2
wandb: 0.16.3
fire: 0.5.0
shortuuid: 1.0.12
fastapi: 0.110.0
rich: 13.7.1
seaborn: 0.13.2
Gabriellamin commented 2 months ago

Hi, thank you for providing additional information. It still has conflicts because of package huggingface-hub and transformers. Could you clarify the version of huggingface-hub and transformers?

Collecting git+https://github.com/yizhongw/transformers.git@left_padding (from -r requirements_new.txt (line 14))
  Cloning https://github.com/yizhongw/transformers.git (to revision left_padding) to /tmp/pip-req-build-45st_9qf
  Running command git clone --filter=blob:none --quiet https://github.com/yizhongw/transformers.git /tmp/pip-req-build-45st_9qf
  Running command git checkout -b left_padding --track origin/left_padding
  Switched to a new branch 'left_padding'
  Branch 'left_padding' set up to track remote branch 'left_padding' from 'origin'.
  Resolved https://github.com/yizhongw/transformers.git to commit fb2b3302c67915c40a2b4fb6711b7b5c5a8bb2a8
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting scikit-learn==1.4.1.post1 (from -r requirements_new.txt (line 1))
  Obtaining dependency information for scikit-learn==1.4.1.post1 from https://files.pythonhosted.org/packages/b2/08/3696c9426c65e8a27831c7270d8df0facc023b65aee318f18cf9dacf10f3/scikit_learn-1.4.1.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached scikit_learn-1.4.1.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Collecting torch==2.1.2 (from -r requirements_new.txt (line 2))
  Obtaining dependency information for torch==2.1.2 from https://files.pythonhosted.org/packages/da/6a/7fb9d82db4568834ff6d4df2fe3b143de4ed65a3f8f93e7daed703626cb6/torch-2.1.2-cp311-cp311-manylinux1_x86_64.whl.metadata
  Using cached torch-2.1.2-cp311-cp311-manylinux1_x86_64.whl.metadata (25 kB)
Collecting scipy==1.12.0 (from -r requirements_new.txt (line 3))
  Obtaining dependency information for scipy==1.12.0 from https://files.pythonhosted.org/packages/d4/b8/7169935f9a2ea9e274ad8c21d6133d492079e6ebc3fc69a915c2375616b0/scipy-1.12.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached scipy-1.12.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Collecting packaging==23.2 (from -r requirements_new.txt (line 4))
  Obtaining dependency information for packaging==23.2 from https://files.pythonhosted.org/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl.metadata
  Using cached packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Collecting sentencepiece==0.2.0 (from -r requirements_new.txt (line 5))
  Obtaining dependency information for sentencepiece==0.2.0 from https://files.pythonhosted.org/packages/fb/12/2f5c8d4764b00033cf1c935b702d3bb878d10be9f0b87f0253495832d85f/sentencepiece-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached sentencepiece-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB)
Collecting datasets==2.14.7 (from -r requirements_new.txt (line 6))
  Obtaining dependency information for datasets==2.14.7 from https://files.pythonhosted.org/packages/00/23/80a2147a547cb2fd59eb92a13787c849b3efaefcea02a5c963dfc93f7c56/datasets-2.14.7-py3-none-any.whl.metadata
  Using cached datasets-2.14.7-py3-none-any.whl.metadata (19 kB)
Collecting deepspeed==0.13.4 (from -r requirements_new.txt (line 7))
  Using cached deepspeed-0.13.4.tar.gz (1.3 MB)
  Preparing metadata (setup.py) ... done
Collecting accelerate==0.22.0 (from -r requirements_new.txt (line 8))
  Obtaining dependency information for accelerate==0.22.0 from https://files.pythonhosted.org/packages/4d/a7/05c67003d659a0035f2b3a8cf389c1d9645865aee84a73ce99ddab16682f/accelerate-0.22.0-py3-none-any.whl.metadata
  Using cached accelerate-0.22.0-py3-none-any.whl.metadata (17 kB)
Collecting peft==0.9.0 (from -r requirements_new.txt (line 9))
  Obtaining dependency information for peft==0.9.0 from https://files.pythonhosted.org/packages/08/87/3e7eb34ac06d3f4ac72e2302e9e69bef12247a8a627c59a4d8a498135727/peft-0.9.0-py3-none-any.whl.metadata
  Using cached peft-0.9.0-py3-none-any.whl.metadata (13 kB)
Collecting bitsandbytes==0.42.0 (from -r requirements_new.txt (line 10))
  Obtaining dependency information for bitsandbytes==0.42.0 from https://files.pythonhosted.org/packages/9b/63/489ef9cd7a33c1f08f1b2be51d1b511883c5e34591aaa9873b30021cd679/bitsandbytes-0.42.0-py3-none-any.whl.metadata
  Using cached bitsandbytes-0.42.0-py3-none-any.whl.metadata (9.9 kB)
Collecting evaluate==0.4.1 (from -r requirements_new.txt (line 11))
  Obtaining dependency information for evaluate==0.4.1 from https://files.pythonhosted.org/packages/70/63/7644a1eb7b0297e585a6adec98ed9e575309bb973c33b394dae66bc35c69/evaluate-0.4.1-py3-none-any.whl.metadata
  Using cached evaluate-0.4.1-py3-none-any.whl.metadata (9.4 kB)
Collecting tokenizers==0.15.2 (from -r requirements_new.txt (line 12))
  Obtaining dependency information for tokenizers==0.15.2 from https://files.pythonhosted.org/packages/15/0b/c09b2c0dc688c82adadaa0d5080983de3ce920f4a5cbadb7eaa5302ad251/tokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached tokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting protobuf==4.25.3 (from -r requirements_new.txt (line 13))
  Obtaining dependency information for protobuf==4.25.3 from https://files.pythonhosted.org/packages/15/db/7f731524fe0e56c6b2eb57d05b55d3badd80ef7d1f1ed59db191b2fdd8ab/protobuf-4.25.3-cp37-abi3-manylinux2014_x86_64.whl.metadata
  Using cached protobuf-4.25.3-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes)
Collecting seaborn==0.13.2 (from -r requirements_new.txt (line 16))
  Obtaining dependency information for seaborn==0.13.2 from https://files.pythonhosted.org/packages/83/11/00d3c3dfc25ad54e731d91449895a79e4bf2384dc3ac01809010ba88f6d5/seaborn-0.13.2-py3-none-any.whl.metadata
  Using cached seaborn-0.13.2-py3-none-any.whl.metadata (5.4 kB)
Collecting vllm==0.3.3 (from -r requirements_new.txt (line 17))
  Obtaining dependency information for vllm==0.3.3 from https://files.pythonhosted.org/packages/bc/d7/f7e980951fdf884df0ec9eba088fd2158b187cc6af521c2137d8cb4cfb73/vllm-0.3.3-cp311-cp311-manylinux1_x86_64.whl.metadata
  Using cached vllm-0.3.3-cp311-cp311-manylinux1_x86_64.whl.metadata (7.8 kB)
Collecting rouge_score==0.1.2 (from -r requirements_new.txt (line 18))
  Using cached rouge_score-0.1.2-py3-none-any.whl
Collecting tensorboard==2.16.2 (from -r requirements_new.txt (line 19))
  Obtaining dependency information for tensorboard==2.16.2 from https://files.pythonhosted.org/packages/3a/d0/b97889ffa769e2d1fdebb632084d5e8b53fc299d43a537acee7ec0c021a3/tensorboard-2.16.2-py3-none-any.whl.metadata
  Using cached tensorboard-2.16.2-py3-none-any.whl.metadata (1.6 kB)
Collecting wandb==0.16.3 (from -r requirements_new.txt (line 20))
  Obtaining dependency information for wandb==0.16.3 from https://files.pythonhosted.org/packages/c4/b0/5efefacd9d12b411ebe57c3db6d05a38883cd52e0ff46ca7b217df3151a1/wandb-0.16.3-py3-none-any.whl.metadata
  Using cached wandb-0.16.3-py3-none-any.whl.metadata (9.9 kB)
Collecting fire==0.5.0 (from -r requirements_new.txt (line 21))
  Using cached fire-0.5.0.tar.gz (88 kB)
  Preparing metadata (setup.py) ... done
Collecting shortuuid==1.0.12 (from -r requirements_new.txt (line 22))
  Obtaining dependency information for shortuuid==1.0.12 from https://files.pythonhosted.org/packages/db/ad/24714961452e94152c12ef340841fbcac6ce6deb9e07854142a11d1a31ff/shortuuid-1.0.12-py3-none-any.whl.metadata
  Using cached shortuuid-1.0.12-py3-none-any.whl.metadata (5.9 kB)
Collecting fastapi==0.110.0 (from -r requirements_new.txt (line 23))
  Obtaining dependency information for fastapi==0.110.0 from https://files.pythonhosted.org/packages/f0/f7/ea860cb8aa18e326f411e32ab537424690a53db20de6bad73d70da611fae/fastapi-0.110.0-py3-none-any.whl.metadata
  Using cached fastapi-0.110.0-py3-none-any.whl.metadata (25 kB)
Collecting rich==13.7.1 (from -r requirements_new.txt (line 24))
  Obtaining dependency information for rich==13.7.1 from https://files.pythonhosted.org/packages/87/67/a37f6214d0e9fe57f6ae54b2956d550ca8365857f42a1ce0392bb21d9410/rich-13.7.1-py3-none-any.whl.metadata
  Using cached rich-13.7.1-py3-none-any.whl.metadata (18 kB)
Requirement already satisfied: numpy<2.0,>=1.19.5 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from scikit-learn==1.4.1.post1->-r requirements_new.txt (line 1)) (1.24.3)
Requirement already satisfied: joblib>=1.2.0 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from scikit-learn==1.4.1.post1->-r requirements_new.txt (line 1)) (1.2.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from scikit-learn==1.4.1.post1->-r requirements_new.txt (line 1)) (2.2.0)
Requirement already satisfied: filelock in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from torch==2.1.2->-r requirements_new.txt (line 2)) (3.9.0)
Requirement already satisfied: typing-extensions in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from torch==2.1.2->-r requirements_new.txt (line 2)) (4.7.1)
Requirement already satisfied: sympy in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from torch==2.1.2->-r requirements_new.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from torch==2.1.2->-r requirements_new.txt (line 2)) (3.1)
Requirement already satisfied: jinja2 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from torch==2.1.2->-r requirements_new.txt (line 2)) (3.1.2)
Requirement already satisfied: fsspec in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from torch==2.1.2->-r requirements_new.txt (line 2)) (2023.4.0)
Collecting nvidia-cuda-nvrtc-cu12==12.1.105 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cuda-nvrtc-cu12==12.1.105 from https://files.pythonhosted.org/packages/b6/9f/c64c03f49d6fbc56196664d05dba14e3a561038a81a638eeb47f4d4cfd48/nvidia_cuda_nvrtc_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cuda_nvrtc_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-runtime-cu12==12.1.105 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cuda-runtime-cu12==12.1.105 from https://files.pythonhosted.org/packages/eb/d5/c68b1d2cdfcc59e72e8a5949a37ddb22ae6cade80cd4a57a84d4c8b55472/nvidia_cuda_runtime_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cuda_runtime_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-cupti-cu12==12.1.105 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cuda-cupti-cu12==12.1.105 from https://files.pythonhosted.org/packages/7e/00/6b218edd739ecfc60524e585ba8e6b00554dd908de2c9c66c1af3e44e18d/nvidia_cuda_cupti_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cuda_cupti_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cudnn-cu12==8.9.2.26 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cudnn-cu12==8.9.2.26 from https://files.pythonhosted.org/packages/ff/74/a2e2be7fb83aaedec84f391f082cf765dfb635e7caa9b49065f73e4835d8/nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cublas-cu12==12.1.3.1 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cublas-cu12==12.1.3.1 from https://files.pythonhosted.org/packages/37/6d/121efd7382d5b0284239f4ab1fc1590d86d34ed4a4a2fdb13b30ca8e5740/nvidia_cublas_cu12-12.1.3.1-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cublas_cu12-12.1.3.1-py3-none-manylinux1_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cufft-cu12==11.0.2.54 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cufft-cu12==11.0.2.54 from https://files.pythonhosted.org/packages/86/94/eb540db023ce1d162e7bea9f8f5aa781d57c65aed513c33ee9a5123ead4d/nvidia_cufft_cu12-11.0.2.54-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cufft_cu12-11.0.2.54-py3-none-manylinux1_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-curand-cu12==10.3.2.106 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-curand-cu12==10.3.2.106 from https://files.pythonhosted.org/packages/44/31/4890b1c9abc496303412947fc7dcea3d14861720642b49e8ceed89636705/nvidia_curand_cu12-10.3.2.106-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_curand_cu12-10.3.2.106-py3-none-manylinux1_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cusolver-cu12==11.4.5.107 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cusolver-cu12==11.4.5.107 from https://files.pythonhosted.org/packages/bc/1d/8de1e5c67099015c834315e333911273a8c6aaba78923dd1d1e25fc5f217/nvidia_cusolver_cu12-11.4.5.107-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cusolver_cu12-11.4.5.107-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cusparse-cu12==12.1.0.106 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-cusparse-cu12==12.1.0.106 from https://files.pythonhosted.org/packages/65/5b/cfaeebf25cd9fdec14338ccb16f6b2c4c7fa9163aefcf057d86b9cc248bb/nvidia_cusparse_cu12-12.1.0.106-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_cusparse_cu12-12.1.0.106-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-nccl-cu12==2.18.1 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-nccl-cu12==2.18.1 from https://files.pythonhosted.org/packages/a4/05/23f8f38eec3d28e4915725b233c24d8f1a33cb6540a882f7b54be1befa02/nvidia_nccl_cu12-2.18.1-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_nccl_cu12-2.18.1-py3-none-manylinux1_x86_64.whl.metadata (1.8 kB)
Collecting nvidia-nvtx-cu12==12.1.105 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for nvidia-nvtx-cu12==12.1.105 from https://files.pythonhosted.org/packages/da/d3/8057f0587683ed2fcd4dbfbdfdfa807b9160b809976099d36b8f60d08f03/nvidia_nvtx_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata
  Using cached nvidia_nvtx_cu12-12.1.105-py3-none-manylinux1_x86_64.whl.metadata (1.7 kB)
Collecting triton==2.1.0 (from torch==2.1.2->-r requirements_new.txt (line 2))
  Obtaining dependency information for triton==2.1.0 from https://files.pythonhosted.org/packages/5c/c1/54fffb2eb13d293d9a429fead3646752ea190de0229bcf3d591ba2481263/triton-2.1.0-0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata
  Using cached triton-2.1.0-0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.3 kB)
Requirement already satisfied: pyarrow>=8.0.0 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (11.0.0)
Collecting pyarrow-hotfix (from datasets==2.14.7->-r requirements_new.txt (line 6))
  Obtaining dependency information for pyarrow-hotfix from https://files.pythonhosted.org/packages/e4/f4/9ec2222f5f5f8ea04f66f184caafd991a39c8782e31f5b0266f101cb68ca/pyarrow_hotfix-0.6-py3-none-any.whl.metadata
  Using cached pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB)
Requirement already satisfied: dill<0.3.8,>=0.3.0 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (0.3.6)
Requirement already satisfied: pandas in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (2.0.3)
Requirement already satisfied: requests>=2.19.0 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (2.31.0)
Requirement already satisfied: tqdm>=4.62.1 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (4.65.0)
Requirement already satisfied: xxhash in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (2.0.2)
Requirement already satisfied: multiprocess in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (0.70.14)
Requirement already satisfied: aiohttp in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (3.8.5)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.14.0 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (0.15.1)
Requirement already satisfied: pyyaml>=5.1 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from datasets==2.14.7->-r requirements_new.txt (line 6)) (6.0)
Collecting hjson (from deepspeed==0.13.4->-r requirements_new.txt (line 7))
  Obtaining dependency information for hjson from https://files.pythonhosted.org/packages/1f/7f/13cd798d180af4bf4c0ceddeefba2b864a63c71645abc0308b768d67bb81/hjson-3.1.0-py3-none-any.whl.metadata
  Using cached hjson-3.1.0-py3-none-any.whl.metadata (2.6 kB)
Collecting ninja (from deepspeed==0.13.4->-r requirements_new.txt (line 7))
  Obtaining dependency information for ninja from https://files.pythonhosted.org/packages/6d/92/8d7aebd4430ab5ff65df2bfee6d5745f95c004284db2d8ca76dcbfd9de47/ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl.metadata
  Using cached ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl.metadata (5.3 kB)
Requirement already satisfied: psutil in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from deepspeed==0.13.4->-r requirements_new.txt (line 7)) (5.9.0)
Requirement already satisfied: py-cpuinfo in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from deepspeed==0.13.4->-r requirements_new.txt (line 7)) (8.0.0)
Requirement already satisfied: pydantic in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from deepspeed==0.13.4->-r requirements_new.txt (line 7)) (1.10.8)
Collecting pynvml (from deepspeed==0.13.4->-r requirements_new.txt (line 7))
  Obtaining dependency information for pynvml from https://files.pythonhosted.org/packages/5b/9c/adb8070059caaa15d5a572b66bccd95900d8c1b9fa54d6ecea6ae97448d1/pynvml-11.5.0-py3-none-any.whl.metadata
  Using cached pynvml-11.5.0-py3-none-any.whl.metadata (7.8 kB)
Requirement already satisfied: safetensors in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from peft==0.9.0->-r requirements_new.txt (line 9)) (0.3.2)
Collecting huggingface-hub<1.0.0,>=0.14.0 (from datasets==2.14.7->-r requirements_new.txt (line 6))
  Obtaining dependency information for huggingface-hub<1.0.0,>=0.14.0 from https://files.pythonhosted.org/packages/66/e8/bbbad5c7b49c68def42830f96c606e693bfa935a886740a363f04cb84e44/huggingface_hub-0.23.3-py3-none-any.whl.metadata
  Using cached huggingface_hub-0.23.3-py3-none-any.whl.metadata (12 kB)
Requirement already satisfied: responses<0.19 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from evaluate==0.4.1->-r requirements_new.txt (line 11)) (0.13.3)
Requirement already satisfied: matplotlib!=3.6.1,>=3.4 in /home/ubuntu/anaconda3/lib/python3.11/site-packages (from seaborn==0.13.2->-r requirements_new.txt (line 16)) (3.7.2)
Collecting ray>=2.9 (from vllm==0.3.3->-r requirements_new.txt (line 17))
  Obtaining dependency information for ray>=2.9 from https://files.pythonhosted.org/packages/d7/37/7480de9ce68faf12d67360892d856ad4e2a140dd60768f68bcacfb4ef924/ray-2.24.0-cp311-cp311-manylinux2014_x86_64.whl.metadata
  Using cached ray-2.24.0-cp311-cp311-manylinux2014_x86_64.whl.metadata (13 kB)
INFO: pip is looking at multiple versions of vllm to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install -r requirements_new.txt (line 17), -r requirements_new.txt (line 9) and transformers 4.35.0.dev0 (from git+https://github.com/yizhongw/transformers.git@left_padding) because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested transformers 4.35.0.dev0 (from git+https://github.com/yizhongw/transformers.git@left_padding)
    peft 0.9.0 depends on transformers
    vllm 0.3.3 depends on transformers>=4.38.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

Another question is, do I need to keep git+https://github.com/yizhongw/transformers.git@left_padding in the requirements.txt? When I didn't keep this line, the error is:

ERROR: Cannot install peft and tokenizers==0.15.2 because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested tokenizers==0.15.2
    transformers 4.41.2 depends on tokenizers<0.20 and >=0.19
    The user requested tokenizers==0.15.2
    transformers 4.41.1 depends on tokenizers<0.20 and >=0.19
    The user requested tokenizers==0.15.2
    transformers 4.41.0 depends on tokenizers<0.20 and >=0.19
    The user requested tokenizers==0.15.2
    transformers 4.40.2 depends on tokenizers<0.20 and >=0.19
    The user requested tokenizers==0.15.2
    transformers 4.40.1 depends on tokenizers<0.20 and >=0.19
    The user requested tokenizers==0.15.2
    transformers 4.40.0 depends on tokenizers<0.20 and >=0.19
lolipopshock commented 2 months ago

We used git+https://github.com/yizhongw/transformers.git@left_padding to install transformers first (it might not matter that much actually) and the version of them are: