V0.2.4 rocm codspeed - Githubissues

EmbeddedLLM / vllm

vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

https://vllm.readthedocs.io

Apache License 2.0

89 stars 5 forks source link

Closed haoshan98 closed 11 months ago