-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
日志中显示成功保存参数pytorch_model.bin:
![image](https://github.com/THUDM/ChatGLM-6B/assets/47592644/d…
-
Q:os数据集中os-std-003-ac-00000数据已经重复尝试几次,一直提示Worker not responding,其余143条数据均能正常评估,报错信息如下
`Warning: chatglm2-6b/os-std#std-003-ac-00000 failed with error INTERACT_FAILED {"detail":"Error: Worker not resp…
-
怎么提高GLM2模型的推理速度
-
rt
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
model_source: hf_model
WAR…
-
先用chatglm2-6b生成fp16.flm和int4.flm,然后分别测速:
cuda:11.6
GPU:matrox g200eh3
batch=1
测速代码:
start = time.time()
text = "中国法定货币是什么?"
outs = ""
for i in range(10):
out = model.response(text)
…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
想测一下这些模型:chatglm2-6b-32k chatglm2-6b-base chatglm2-12b-base 找不到国内可下载的地址。
### Expected Beh…
-
在尝试使用[torchkeras](https://github.com/lyhue1991/torchkeras/tree/master)/[examples](https://github.com/lyhue1991/torchkeras/tree/master/examples)
/ChatGLM2_AdaLoRA——transformers.ipynb的时候发现,当进行数据转换步骤的时候…
-
./build/bin/main -m chatglm-ggml.bin -i 可以正常使用
但是使用cd examples && python3 cli_chat.py -m ../chatglm2-ggml.bin -i 的时候报错显示
zsh: illegal hardware instruction python3 web_demo.py -m ../chatglm2-ggml.bi…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
python test.py
Explicitly passing a `revision` is encouraged when loading a model with…