Closed FreeRotate closed 1 month ago
支持vllm0.4.2版本,修复"Compile with TORCH_USE_CUDA_DSA to enable device-side assertions."的bug,支持T4等算力较低的显卡
TORCH_USE_CUDA_DSA
支持vllm0.4.2版本,修复"Compile with
TORCH_USE_CUDA_DSA
to enable device-side assertions."的bug,支持T4等算力较低的显卡