runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
220 stars 85 forks source link

Could not build wheels for vllm #8

Closed Mr-Nobody1 closed 8 months ago

Mr-Nobody1 commented 11 months ago
  Obtaining dependency information for fastapi from https://files.pythonhosted.org/packages/76/e5/ca411b260caa4e72f9ac5482f331fe74fd4eb5b97aa74d1d2806ccf07e2c/fastapi-0.103.1-py3-none-any.whl.metadata
  Downloading fastapi-0.103.1-py3-none-any.whl.metadata (24 kB)
 INFO: pip is looking at multiple versions of fastapi[all] to determine which version is compatible with other requirements. This could take a while.
 ERROR: Cannot install -r /requirements.txt (line 4), fastapi and fastapi[all]==0.103.2 because these package versions have conflicting dependencies.
#0 65.25
#0 65.25 The conflict is caused by:
#0 65.25     The user requested fastapi
#0 65.25     vllm 0.1.7 depends on fastapi
#0 65.25     fastapi[all] 0.103.2 depends on fastapi 0.103.2 (from https://files.pythonhosted.org/packages/4d/d2/3ad038a2365fefbac19d9a046cab7ce45f4c7bfa81d877cbece9707de9ce/fastapi-0.103.2-py3-none-any.whl (from https://pypi.org/simple/fastapi/) (requires-python:>=3.7))

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

I removed the dependencies version from requirements.txt and now it gives me this

#0 1903.7 Failed to build vllm
#0 1903.7 ERROR: Could not build wheels for vllm, which is required to install pyproject.toml-based projects

COPY builder/requirements.txt /requirements.txt
RUN --mount=type=cache,target=/root/.cache/pip \
pip install --upgrade pip && \
pip install --upgrade -r /requirements.txt --no-cache-dir && \
rm /requirements.txt
ERROR: failed to solve: process "/bin/bash -o pipefail -c pip install --upgrade pip &&     pip install --upgrade -r /requirements.txt --no-cache-dir &&     rm /requirements.txt" did not complete successfully: exit code: 1
alpayariyak commented 8 months ago

Fixed in latest version