-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
![image](https://github.com/THUDM/ChatGLM2-6B/assets/66857797/ea9537ae-5002-4640-bbce-e…
-
PS E:\Workspace\chatglm2-6b-explorer\src> python gallery.gradio.py
Traceback (most recent call last):
File "E:\Workspace\chatglm2-6b-explorer\src\gallery.gradio.py", line 3, in
from apps imp…
kency updated
11 months ago
-
8af372aacd93a\modeling_chatglm.py", line 542, in forward
attention_output, kv_cache = self.self_attention(
File "D:\ChatGLM2-Voice-Cloning\env\lib\site-packages\torch\nn\modules\module.py", li…
-
执行convert.py,直接就退出了,不能成功转换。
(chatglmcpp) F:\llmbak\chatglm.cpp-main>python chatglm_cpp/convert.py -i F:\llmbak\chatglm2\chatglm2-6b -t q8_0 -o F:\llmbak\chatglm2\chatglm2-6b-q8-0-ggml.bin
Loading ch…
-
感谢提升了一倍的效率。但是时间还是太长了,用的机器是A10,24G现存,都是单线程先后4次请求,(开4个线程同时请求更慢)。
请问还有什么提升空间吗
chatglm2 base:
![5743c2c08dec457bd46d7b37e452c109](https://github.com/ztxz16/fastllm/assets/55828495/02f0f641-ede7-48f1-90…
-
Can I use the chatGLM2 and chatGLM3 models to conduct experiments? Are there any modifications required? Thank you very much.
-
as the title say, do we support these ?
-
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the ex…
bullw updated
4 months ago
-
### Installation Method | 安装方法与平台
Docker(Linux)
### Version | 版本
Latest | 最新版
### OS | 操作系统
Linux
### Describe the bug | 简述
使用Debian 12+NVIDIA M40 24G的组合进行该项目的部署,使用的部署方式是Docker的方案0。
使用chatgl…
-
chatglm2_loar运行错误,提示glm2没有实现这个方法
model.enable_input_require_grads() NotImplementedError