InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
3.13k stars 280 forks source link

Add model revision & download_dir to cli #1814

Closed irexyc closed 1 week ago

irexyc commented 1 week ago

Motivation

support deploy specific revison of hf model

lmdeploy chat internlm/internlm2-chat-1_8b --revision v1.0.0

address https://github.com/InternLM/lmdeploy/issues/1804