search

ray-project / llmperf

LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
659 stars 113 forks source link

how to test vllm interface #77

Open ZTurboX opened 1 month ago

ZTurboX commented 1 month ago

how to test vllm interface