search

THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.68k stars 1.85k forks source link

[Feature] 麻烦自己怎么离线量化呢？有方法吗 #628

Open lonngxiang opened 9 months ago

lonngxiang commented 9 months ago

Is your feature request related to a problem? Please describe.

No response

Solutions

麻烦自己怎么离线量化呢？有方法吗 int8，int4

Additional context

No response