Closed iclgg closed 6 months ago
ptxas /tmp/tmpxft_00000ba5_00000000-6_marlin_cuda_kernel.ptx, line 215; error : Unknown modifier '.fractional' ptxas /tmp/tmpxft_00000ba5_00000000-6_marlin_cuda_kernel.ptx, line 215; fatal : Parsing error near ':': syntax error ptxas fatal : Ptx assembly aborted due to errors
Your cuda and nvcc version is too old. Please follow and read https://docs.vllm.ai/en/latest/getting_started/installation.html .
my computer can only max support cu113 + torch1.12.1, so how can i install vllm
You can reach out to your admin to upgrade driver and cuda version.
Your current environment
How you are installing vllm
I have used ... to omit many similar output messages.
cuda and nvcc: