[Misc]: vLLM v0.6.0 CUDA 12 missing wheel file

vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

https://docs.vllm.ai

Apache License 2.0

26.84k stars 3.94k forks source link

Open JasmondL opened 6 days ago

JasmondL commented 6 days ago

I'd like to understand why the most recent release is omitting the CUDA 12 wheel package built?

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

youkaichao commented 6 days ago

the wheels in pypi https://pypi.org/project/vllm/ should be cuda 12

cc @simon-mo if the release pipeline changed, the release page https://github.com/vllm-project/vllm/releases/tag/v0.6.0 indeed only has cuda 11 wheels.