LMCache / lmcache-tests

3 stars 4 forks source link

Adapted LMCache Test to new version #10

Closed qyy2003 closed 3 weeks ago

qyy2003 commented 3 weeks ago

Update installation script in the current lmcache-tests repo to new LMCache (install from source) Update the command line for Local bootstraper to use the latest lmcache_vllm

Python 3.10/3.11/3.12 are all verified。 Tested on test_lmcache_local_cpu and test_lmcache_remote_disk

ApostaC commented 3 weeks ago

Thanks! Will start reviewing soon!

qyy2003 commented 3 weeks ago

@ApostaC I've deleted it.~