InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
4.46k stars 403 forks source link

[Feature] AWQ量化的校准数据集 #1671

Open GZL11 opened 4 months ago

GZL11 commented 4 months ago

Motivation

AssertionError: Support only c4, ptb, wikitext2 or pileval. 可以支持本地的数据集作为校准数据集吗,校准数据集的格式有什么要求吗?

Related resources

No response

Additional context

No response

AllentDan commented 1 month ago

Possible solutions: https://github.com/InternLM/lmdeploy/issues/1142#issuecomment-2072588598 https://github.com/InternLM/lmdeploy/issues/1865