Closed simonw closed 11 months ago
I'm going to depend on LLM 0.7 or higher and have the download-model ... --alias llama2
option work by writing to the aliases.json
file.
I just noticed that this:
llm mlc download-model Llama-2-7b-chat
Results in a model activated like this:
llm -m mlc-chat-Llama-2-7b-chat-hf-q4f16_1 \
'five names for a cute pet ferret'
It should set up Llama-2-7b-chat
as an alias automatically too.
Maybe a
-a/--alias
option that can be passed zero or more times to thellm mlc download-model
command.It would be useful to apply aliases later as well, but I think that's a feature that should go in LLM itself.