mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
17.73k stars 1.41k forks source link

[Bug] Could not find a version that satisfies the requirement during installation of prebuilt packages #2605

Open SamKG opened 1 week ago

SamKG commented 1 week ago

🐛 Bug

Installation via pip as specified in the documentation of the prebuilt packages seems to fail with the error

ERROR: Could not find a version that satisfies the requirement mlc-llm-nightly-cu121 (from versions: none)
ERROR: No matching distribution found for mlc-llm-nightly-cu121

To Reproduce

Steps to reproduce the behavior:

  1. python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-nightly-cu121 mlc-ai-nightly-cu121

Expected behavior

Package installs

Environment

MasterJH5574 commented 5 days ago

Hi @SamKG, could you check if python --version shows Python 2 or Python 3? If it shows Python 2, we need to use python3 -m pip install ....

SamKG commented 5 days ago

Hi,

Here is the output for python --version:

$ python --version
Python 3.10.14

I am using python 3.10.14.

MasterJH5574 commented 5 days ago

Thanks for the quick response! This issue looks interesting and our end doesn't have the problem. Could you try manual download these two wheels and install them via python -m pip install [package-name].whl? These two should be the matched ones.