THUDM ChatGLM3 issues - Githubissues

THUDM / ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

Apache License 2.0

13.5k stars 1.57k forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

微调示例运行问题

#1337 hgh-xxh opened 1 day ago
1
vllm==0.5.5orvllm==0.4.2都安转不上

#1336 18595071403 opened 1 week ago
0
请问用什么工具可以INT4 量化 ChatGLM3-6B这个模型？

#1334 shawn9977 opened 2 weeks ago
0
请问：ChatGLM3如何转成llama格式？

#1330 avBuffer opened 3 weeks ago
0
手动调用mode()方法和直接调用model.generate()方法，输出的结果十分不同

#1328 rooikeee opened 1 month ago
0
服务器部署chatglm3模型后，用postman开两个窗口几乎同时调用/v1/chat/completions这个接口（流式输出），最后回答的文本时看不懂的文字，如下图，平时问答是几秒，现在响应时间持续几十秒，输出的都是看不懂的文字

#1327 levorge opened 1 month ago
0
前端如何调用这个/v1/chat/completions流式输出接口

#1326 levorge closed 1 month ago
1
Update gradio demo

#1325 masterLazy opened 1 month ago
0
TypeError: ChatGLMTokenizer._pad() got an unexpected keyword argument 'padding_side'

#1324 jeejeelee opened 1 month ago
21
8G显存运行 basic_demo 加载到29%退出，无报错

#1323 nick-bai opened 1 month ago
2
TypeError: GenerationMixin._extract_past_from_model_output() got an unexpected keyword argument 'standardize_cache_format'

#1321 zhoujiaxinii opened 2 months ago
2
Loading checkpoint shards: 0%| 进度始终为0 无法加载

#1317 YourFau1t closed 2 months ago
1
torch.compile 生成大量的图

#1316 limitmhw closed 2 months ago
2
启动cli_demo.py报错

#1315 dabing9 closed 2 months ago
2
openai_api_request.py请求超时

#1314 nightISend opened 3 months ago
0
使用ptuning_v2微调过程中出现报错ValueError: Hypothesis is empty.

#1312 Lky0312 opened 3 months ago
0
tools_using_demo中的openai_api_demo.py，stream等于True的时候 finish_reason 不出现"function_call"

#1311 guolushi-7 opened 3 months ago
1
The figure in execute function will be valued as None

#1310 Stephen-SMJ opened 3 months ago
0
在ChatGLM3-6B的微调过程中，遇到如下报错（The following error occurs during the fine-tuning of ChatGLM3-6B)ImportError: cannot import name 'log' from 'torch.distributed.elastic.agent.server.api'

#1308 Scorponok31 opened 3 months ago
0
ModuleNotFoundError: No module named 'huggingface_hub.inference._text_generation'

#1307 virtualpeer opened 3 months ago
3
chatglm3-6b-base api方式部署访问模型回答异常

#1306 394988736 closed 3 months ago
1
启动web_demo_gradio.py进行对话时报错ValueError: too many values to unpack (expected 2)

#1305 394988736 closed 3 months ago
1
requirements.txt冲突问题

#1304 ZOUG opened 3 months ago
3
模型无法加载

#1303 daihuaiii closed 2 months ago
2
Intel demo AutoModelForCausalLM model.generate Wrong response by docker run the same chatglm3-int4 model bin file

#1302 ahlwjnj opened 3 months ago
0
chatglm3-6b\modeling_chatglm.py", line 413, in forward ,cache_k, cache_v = kv_cache , ValueError: too many values to unpack (expected 2)

#1300 armstrong1972 closed 2 months ago
4
AttributeError: 'GenerationConfig' object has no attribute '_eos_token_tensor'

#1299 zzlTim opened 3 months ago
3
chatglm3-6b流式请求返回结果时，第一行会自带换行符

#1297 starage2020 opened 4 months ago
1
RuntimeError: Internal: could not parse ModelProto from /Users/wangjun/llm/model/chatglm3-6b/tokenizer.model

#1296 qianyuqx closed 4 months ago
0
chatglm3-6b-32k处理长文本时，out of memory

#1294 SXxinxiaosong opened 4 months ago
1
AttributeError: 'ChatGLMForConditionalGeneration' object has no attribute 'save_checkpoint'

#1293 Solenyalyl closed 2 months ago
2
discord

#1287 zRzRzRzRzRzRzR closed 4 months ago
0
ImportError: cannot import name 'split_torch_state_dict_into_shards' from 'huggingface_hub'

#1286 programmeraudrey closed 4 months ago
3
单机双卡报错RuntimeError: Expected all tensors to be on the same device, but found at least two devices

#1285 Srammark closed 4 months ago
1
[fix#1272]Fix performance of resume from checkpoint

#1283 pandong2011 closed 4 months ago
0
输出模型注意力失败

#1282 BryanMurkyChan closed 1 month ago
1
请问一下，这个composite_demo中的页面demo的源码在什么地方，可以给一份嘛

#1280 kumi-xc closed 4 months ago
1
第一次尝试 github 中 lora_finetune.ipynb 微调示例，未执行成功，报以下错误，请问如何解决？

#1277 thomasyyang opened 5 months ago
1
After update latest,The output is not accurate enough.

#1275 haowaiwai opened 5 months ago
0
update

#1274 zRzRzRzRzRzRzR closed 5 months ago
0
openai_api 怎么配置多gpu启动？

#1273 ttaop closed 4 months ago
1
finetune_hf.py中的resume_from_checkpoint部分可能存在影响性能以及值得改进的地方

#1272 pandong2011 closed 4 months ago
3
微调中途报错BatchEncoding.to() got an unexpected keyword argument 'non_blocking'

#1270 lmdegit closed 4 months ago
2
fix #1268

#1269 zRzRzRzRzRzRzR closed 5 months ago
0
inconsistent `tool_def` in examples

#1268 foldl closed 5 months ago
0
数据读取时的问题

#1267 Ye-XX closed 5 months ago
0
运行 api_server.py ，请求返回异常

#1265 hanqingwu closed 5 months ago
2
用这里的ChatGLM3 + 魔搭社区的ChatGLM3-6B的模型在阿里云微调官方示例，但Running Evaluation时出错，请求指导。

#1264 easychu closed 5 months ago
6
使用finetune_demo/finetune_hf.py的lora微调之后，用finetune_demo/inference_hf.py做推理了的时候加载权重后无反应

#1263 great-wind closed 1 month ago
3
但是这样做代码会自动复原，加入的代码就被冲刷掉了> 请问你解决了吗？

#1262 AHPUymhd closed 4 months ago
1