-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
如果是:
`tokenizer = AutoTokenizer.from_pretrained("chatglm2-6b/", trust_remote_code=True)
mod…
-
### System Info
- CPU architecture: x86_64
- GPU properties
- GPU name: NVIDIA A100
- GPU memory size: 40G
- Libraries
- TensorRT-LLM branch or tag: v0.9.0
-…
-
### Is there an existing issue for this?
- [x] I have searched the existing issues
### Current Behavior
ptuning 执行训练时报错
bash train.sh
```
# bash train.sh
master_addr is only used for static r…
-
感谢您参与 X2Paddle 社区! 问题模版为了 X2Paddle 能更好的迭代,例如新功能发布、 RoadMaps 和错误跟踪. :smile_cat:
## 问题描述
- 错误信息
ValueError: This protobuf of onnx model is too large (>2GB). Call check_model with model path inste…
-
### Is your feature request related to a problem? Please describe.
_No response_
### Solutions
在不出,都快忘记了还有chaglm这个系列。。。
### Additional context
_No response_
-
### 🚀 The feature, motivation and pitch
This project is very nice! Chatglm2-6b and chatglm3-6b work well in this project. But could you restore support for chatglm-6b? It's a very popular model.
###…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
**Eng:**
Why wasn't the local model used, according to the error message? It seems tha…
-
Hi, thank you very much for your excellent work !
I try to run the code using ChatGLM2, but the following error occurs:
Loading checkpoint shards: 100%|████████████████████████████████████████████…
-
非常感谢你们的工作,
当前版本似乎不支持单机多卡推理。在 8 x RTX 2080 TI 11G 的机子上加载未量化的chatglm2-6b-f16权重,ggml可以检测到8块显卡,但是所有权重都被扔到第一块卡上,导致cuda out of memory。同样的main运行q_4的权重没有任何问题。
系统:Ubuntu20.04
bash运行
`$echo CUDA_VISIBLE_DEV…
-
微调出来的模型可以直接用chatglm2官网发版的web_demo2.py来测吗,会有影响吗?