Closed dubaoquan404 closed 1 year ago
python3: /project/lib/Analysis/Utility.cpp:136: bool mlir::supportMMA(mlir::Value, int): Assertion `(version == 1 || version == 2) && "Unexpected MMA layout version found"' failed.
我也是同样的错误,P40 int4量化推理报错。
Pascal架构的显卡不支持,硬件问题。
https://github.com/qwopqwop200/GPTQ-for-LLaMa/issues/142
试试这个方案 https://github.com/openai/triton/issues/1271
python3: /project/lib/Analysis/Utility.cpp:136: bool mlir::supportMMA(mlir::Value, int): Assertion `(version == 1 || version == 2) && "Unexpected MMA layout version found"' failed.