issues
search
li-plus
/
chatglm.cpp
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
MIT License
2.92k
stars
333
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
zsh: illegal hardware instruction
#247
wenfei565
opened
9 months ago
1
Run the following command to report an error python3 chatglm3_demo.py -m ../chatglm3-ggml.bin -p 你好 --temp 0.8 --top_p 0.8
#246
yimingchao432
closed
9 months ago
0
能否在开启openai api时候提供一个public link?
#245
enamespace
closed
7 months ago
1
openai_api 返回为空
#244
lesca
closed
9 months ago
1
拉取新代码
#243
Huojunning
closed
9 months ago
0
Long context result (>450 tokens) from server will stop / return incorrect json (stream mode)
#242
x4080
opened
9 months ago
0
-DGGML_CUBLAS=ON,编译成功之后无法使用显卡进行推理,仍然使用CPU进行推理
#241
wfgods
opened
9 months ago
4
量化后的ChatGlm3-6B使用open_api部署tools功能无法使用
#240
LiuGuBiGu
opened
9 months ago
2
Fix: Dockerfile Building Locally
#239
wangzhe258369
opened
9 months ago
0
v0.3.0 "发布" 里的Python包中的C++程序是以什么配置构建的?
#238
TGJek
opened
9 months ago
0
如何设置更长的上下文(context)
#237
StudyingLover
opened
9 months ago
5
mac m1 启动cli_demo.py时,抛出incompatible architecture异常
#236
jeceldx
closed
9 months ago
1
为什么4090显卡用不了,编译成功之后也是用的cpu推理
#235
sammichenVV
closed
9 months ago
5
显存使用增加
#234
Htring
closed
1 month ago
0
【已解决,附解决方法】无法运行 LangChain API ,执行命令后报错, 能否提供能成功运行此命令的 python版本号 和 使用的环境中安装的包的列表
#233
craii
opened
9 months ago
3
更新后运行报错:No module named 'pydantic._internal'
#232
wizardbyron
opened
9 months ago
4
How to construct a ToolCallMessage?
#231
codingl2k1
opened
9 months ago
0
check failed (data != MAP_FAILED) Invalid argument
#230
jqsl2012
opened
9 months ago
1
ChatGLM3 使用 examples/cli_demo.py 时报错 'TypeError: chat() got an unexpected keyword argument 'max_new_tokens''
#229
Legalgeek
opened
9 months ago
1
CodeGeeX2模型转换错误
#228
norlandsoft
opened
9 months ago
2
How to release an old loaded model file using Python.
#227
wanshichenguang
opened
9 months ago
0
Q4_0 + CPU转换避坑指南
#226
catmeowjiao
opened
9 months ago
9
Failed to install python binding for Windows
#225
I-hsin-Chen
opened
9 months ago
2
opeai_api没有支持function call功能
#224
lly277365
closed
8 months ago
0
能否提供对P100 GPU的支持
#223
listenfree
opened
9 months ago
2
请问是否有将chatglm.cpp合并到llama.cpp的计划?
#222
Autumn-Whisper
opened
10 months ago
7
跟新cmke版本后出现问题
#221
Joker-sad
opened
10 months ago
2
openai api 启动后,测试请求无法并行
#220
zhengzhanpeng
opened
10 months ago
0
chatglm_cpp.openai_api:app 支持千问 (qwen)转的bin模型的api么
#219
zhangzai666
opened
10 months ago
0
llama.cpp main命令包含-ngl N 参数 chatglm.cpp 能否支持 CPU+GPU 混合处理
#218
baibuxiha
opened
10 months ago
3
Cmake error on Windows
#217
I-hsin-Chen
closed
9 months ago
4
赞👍🏻 文档写得非常漂亮,从头走到尾没有遇到一点阻碍👍🏻
#216
craii
opened
10 months ago
0
macbook convert失败
#215
guangyuanyu
opened
10 months ago
1
pip安装失败
#214
futz12
closed
10 months ago
1
can not call tool by using q4_0 chatglm3 model
#213
Mrfranken
opened
10 months ago
0
Error: CUDA error when release memory!
#212
chestnut111
opened
10 months ago
2
The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
#211
bigdataer01
opened
10 months ago
3
Add perplexity evaluation script
#210
li-plus
closed
8 months ago
0
Fix docker build error
#209
nzlov
closed
10 months ago
1
Baichuan2-7b-chat Tokenizer and outputs difference between your repo and officical hugginface example.
#208
Zhenzhong1
closed
10 months ago
2
build docker error
#207
nzlov
opened
10 months ago
1
使用 gpu 时 如何指定使用哪一个设备?
#206
WallenHan
opened
10 months ago
4
构建容器后,运行API接口报错
#205
zhangwanshen
closed
10 months ago
1
./build/bin/main -m chatglm3-ggml-q8.bin -i zsh: illegal hardware instruction ./build/bin/main -m chatglm3-ggml-q8.bin -i
#204
oldturkey
opened
10 months ago
5
macbookpro m1量化baichuan2-13b失败
#203
mairongchao
opened
10 months ago
2
Update README for new API
#202
li-plus
closed
10 months ago
0
小白问题,chatglm3-ggml.bin通过python的pipeline报错
#201
listenfree
closed
10 months ago
2
Support max_new_tokens generation option
#200
li-plus
closed
10 months ago
0
Faster repetition penalty sampling operation
#199
li-plus
closed
10 months ago
0
请问能否在iPhone上跑起来呢?
#198
HoodL
opened
10 months ago
1
Previous
Next