issues
search
EmbeddedLLM
/
vllm-rocm
vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
https://vllm.readthedocs.io
Apache License 2.0
83
stars
5
forks
source link
Merge changes from @pcmoritz/vllm-public
#2
Closed
tjtanaa
closed
8 months ago