AttributeError: 'list' object has no attribute 'absmax' when I load Qwen-72B-Chat with 8-bit compression with AirLLMQWen - Githubissues

lyogavin / airllm

AirLLM 70B inference with single 4GB GPU

Apache License 2.0

5.09k stars 408 forks source link

AttributeError: 'list' object has no attribute 'absmax' when I load Qwen-72B-Chat with 8-bit compression with AirLLMQWen #149

Open Yang-bug-star opened 4 months ago

Yang-bug-star commented 4 months ago