issues
search
li-plus
/
chatglm.cpp
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4
MIT License
2.81k
stars
327
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Windows系统 安装 chatGLM 分享
#283
kevin-hu-lab
closed
3 months ago
2
Add sm89 by default for rtx 4090
#282
li-plus
closed
3 months ago
0
docker运行镜像cpu模式下,cpu的利用率最大只有1600%,如何提升?
#281
421hl
opened
3 months ago
4
Update convert.py
#280
futz12
closed
3 months ago
2
Better cuda compile script respecting nvcc version
#279
li-plus
closed
3 months ago
0
Deprecate baichuan & internlm in favor of llama.cpp
#278
li-plus
closed
3 months ago
0
Allocate kv-cache on demand
#277
li-plus
closed
3 months ago
0
Refactor to reduce template usage for faster compilation
#276
li-plus
closed
3 months ago
0
在启用 cuBLAS 之后,等权重数据加载到显存后,最好能释放内存里的权重数据
#275
dogvane
opened
3 months ago
1
什么时候支持amd的gpu
#274
youcanyouupsb
opened
4 months ago
4
在量化模型的时候出现segmentation fault
#273
invalid-pointer
opened
4 months ago
1
使用chatglm_cpp/openai_api.py 提供接口服务,oneapi一测试链接就崩溃
#272
lordk911
opened
4 months ago
1
Fix missing lora path argument in convert script
#271
li-plus
closed
4 months ago
0
如何保存会话,比如,我之前,已经告诉他,让他记住一个电话号码,以后重新启动这个程序,能让他告诉我这个电话号码吗?
#270
lcweik
opened
4 months ago
1
官方docker无法使用
#269
Whichbfj28
opened
4 months ago
1
Docker build failed【Parse error. Expected a command name, got bad character with text "".】
#268
Whichbfj28
opened
4 months ago
0
Illegal instruction
#267
Whichbfj28
opened
4 months ago
0
请求编译好的程序
#266
2531
opened
4 months ago
1
cmake --build build -j --config Release 命令报错
#265
certhon
opened
4 months ago
0
多卡推理
#264
Dreamerzp
opened
4 months ago
0
支持minicpm-2b
#263
wzg-zhuo
opened
5 months ago
1
CMake 编译时出现错误
#262
wuyuncheng-26
closed
2 months ago
1
streamlit run chatglm3_demo.py 执行后报错,No module named 'chatglm_cpp._C' ,是什么原因呢?
#261
gaoxiaoen
opened
5 months ago
3
运行chatglm3-6b-ggml int4量化模型,采用clblast加速反而比cpu加速慢很多,正常吗?
#260
GTJoey
opened
5 months ago
1
我想启动web端提醒这个报错,你们遇到过吗,麻烦给指点一下
#259
dongyongwei
opened
5 months ago
3
macos m2 芯片最后一步出现Illegal instruction: 4
#258
Ventery
closed
5 months ago
1
CMake Error: The source directory "/root/build" does not exist.
#257
pariskang
opened
5 months ago
0
什么时候能够提供fine-tuning的接口?
#256
kw408
closed
2 months ago
1
[Feature]能否添加 --multiline-input 参数,多行输入文字。
#255
aspwow
opened
5 months ago
0
Support function calling in OpenAI api server
#254
li-plus
closed
5 months ago
0
这个框架是否可以用于高并发的生产环境?
#253
aofengdaxia
closed
5 months ago
1
什么时候能支持internLM2
#252
nigel001
closed
3 months ago
2
预计什么时候支持GLM4?
#251
pigeonligh
opened
5 months ago
5
请教下,我在iOS上执行推理代码,主线程没问题,但是我开一条子线程来执行推理代码,就会Crash,难道ChatMessage Pipeline::chat不支持在子线程运行吗?
#250
HoodL
opened
5 months ago
0
【feature request】关于Tool/func调用,有没有方式支持多次自动调用(更长的思维链)
#249
martinyuan886
opened
6 months ago
0
请问下这个报错是什么原因造成的?
#248
Huojunning
opened
6 months ago
1
zsh: illegal hardware instruction
#247
wenfei565
opened
6 months ago
1
Run the following command to report an error python3 chatglm3_demo.py -m ../chatglm3-ggml.bin -p 你好 --temp 0.8 --top_p 0.8
#246
yimingchao432
closed
6 months ago
0
能否在开启openai api时候提供一个public link?
#245
enamespace
closed
4 months ago
1
openai_api 返回为空
#244
lesca
closed
6 months ago
1
拉取新代码
#243
Huojunning
closed
6 months ago
0
Long context result (>450 tokens) from server will stop / return incorrect json (stream mode)
#242
x4080
opened
6 months ago
0
-DGGML_CUBLAS=ON,编译成功之后无法使用显卡进行推理,仍然使用CPU进行推理
#241
wfgods
opened
6 months ago
4
量化后的ChatGlm3-6B使用open_api部署tools功能无法使用
#240
LiuGuBiGu
opened
6 months ago
2
Fix: Dockerfile Building Locally
#239
wangzhe258369
opened
6 months ago
0
v0.3.0 "发布" 里的Python包中的C++程序是以什么配置构建的?
#238
TGJek
opened
6 months ago
0
如何设置更长的上下文(context)
#237
StudyingLover
opened
6 months ago
5
mac m1 启动cli_demo.py时,抛出incompatible architecture异常
#236
jeceldx
closed
6 months ago
1
为什么4090显卡用不了,编译成功之后也是用的cpu推理
#235
sammichenVV
closed
6 months ago
5
显存使用增加
#234
Htring
opened
6 months ago
0
Previous
Next