search

simonw / llm-mlc

LLM plugin for running models using MLC
Apache License 2.0
179 stars 8 forks source link

"No matching distribution found for mlc-chat-nightly" #23

Open gazj opened 6 months ago

gazj commented 6 months ago 
pipx install llm
llm install llm-mlc
llm mlc pip install --pre --force-reinstall \
  mlc-ai-nightly \
  mlc-chat-nightly \
  -f https://mlc.ai/wheels
Looking in links: https://mlc.ai/wheels
Collecting mlc-ai-nightly
  Downloading https://github.com/mlc-ai/package/releases/download/v0.9.dev0/mlc_ai_nightly-0.15.dev138-cp312-cp312-macosx_10_15_x86_64.whl (84.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.0/84.0 MB 16.0 MB/s eta 0:00:00
ERROR: Could not find a version that satisfies the requirement mlc-chat-nightly (from versions: none)
ERROR: No matching distribution found for mlc-chat-nightly

Mac mini M1 macOS 14.3 python 3.12.2 llm 0.13.1

jack4git commented 6 months ago

Same here -- in MLC's instructions it appears maybe they renamed mlc-chat-nightly to mlc-llm-nightly?

Kagi's Quick Answer tells me:

The MLC LLM models and clients have undergone some name changes recently.[1] Originally, the models were named with the prefix mlc-chat- followed by the model name and version, such as mlc-chat-Llama-2-13b-chat-hf-q4f16_1. However, in newer versions the mlc-chat- prefix has been removed. So a model that used to be called mlc-chat-Llama-2-13b-chat-hf-q4f16_1 would now simply be referred to as Llama-2-13b-chat-hf-q4f16_1. This was done to make the model names more consistent and readable.[2] The Python client code has also been updated accordingly to work with both the old and new naming conventions.[3] So in summary, mlc-chat- is no longer included as a prefix in the latest model and client versions, but both the old and new names should work.

funkatron commented 5 months ago

Will llm mlc setup be able to complete with this name change? I'm doing a first-time setup.

slhck commented 5 months ago

See the open PR here: https://github.com/simonw/llm-mlc/pull/24