Closed sgsdxzy closed 1 month ago
Based on https://github.com/vllm-project/vllm/pull/3985 https://github.com/vllm-project/vllm/pull/3919 Fix weight loading for exl2.
Based on https://github.com/vllm-project/vllm/pull/3985 https://github.com/vllm-project/vllm/pull/3919 Fix weight loading for exl2.