search

LMCache / lmcache-tests

3 stars 4 forks source link

Support selecting models from cmd and setting vllm accordingly #14

Closed Shaoting-Feng closed 4 days ago

Shaoting-Feng commented 5 days ago

Change from hard-coded models from tests.py to manual selection (default is Mistral) and automatically config vllm accordingly.

YaoJiayi commented 4 days ago

LGTM, thanks @Shaoting-Feng !