Closed Vincent131499 closed 4 months ago
看介绍导出mnn模型默认是ibt4,请问怎么指定int8量化呢?
参数太多了没有作为参数,可以修改这里:
https://github.com/wangzhaode/llm-export/blob/76fd3d9af5074112f21bfc2dbeec115398e4a027/llm_export.py#L79
看介绍导出mnn模型默认是ibt4,请问怎么指定int8量化呢?