Closed cyente closed 7 months ago
add multi-gpu distribution with vllm
Can we migrate the VLLM section to the README.md file? It would be convenient for users to reference directly.
makes sense, I'll get on it
add multi-gpu distribution with vllm