Closed kliuae closed 8 months ago
Updated the docker file to install dependencies and vLLM automatically, and added a script to run throughput benchmarking
Updated the docker file to install dependencies and vLLM automatically, and added a script to run throughput benchmarking