search

THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.7k stars 1.85k forks source link

[BUG/Help] 为什么chatglma2量化后weight的size会改变<title> #667

Open Paradise59 opened 7 months ago

Paradise59 commented 7 months ago

Is there an existing issue for this?

Current Behavior

微信图片_20240308130434 微信图片_20240308130438

Expected Behavior

No response

Steps To Reproduce

no

Environment

- OS:
- Python:
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :

Anything else?

No response