Closed xyfZzz closed 2 months ago
I believe this offers a clue: WARNING 07-24 11:07:17 _custom_ops.py:14] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm._C'") consider building from source before retry
I believe this offers a clue: WARNING 07-24 11:07:17 _custom_ops.py:14] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm._C'") consider building from source before retry
Hi, I tried to build vllm from source, but still got the same error.
Perhaps upgrading the GPU driver could solve this issue
Perhaps upgrading the GPU driver could solve this issue
Thank you. Upgrading GPU driver solved this problem.
Your current environment
🐛 Describe the bug
First bad request:
Second bad request: