-
### Describe the bug
Code following:
```python
from autogen import oai
response = oai.Completion.create(
config_list=[
{
"model": "chatglm2-6b",
"api_base": "http://0.0…
-
I also validate chatglm and chatglm3, they are works, could you have fix the root cause?
https://huggingface.co/THUDM/chatglm2-6b/discussions/97
python main.py --model hf-causal --model_args pretrai…
-
感觉ChatGLM3-6B模型转换后回答质量没有ChatGLM2-6B的效果好,经常出现回复中英文混搭、循环输出直至达到最大长度等问题。
之前ChatGLM2-6B-32K的模型转换后这个问题很明显,但ChatGLM2-6B基本上没这种问题。
现在ChatGLM3-6B的模型不论是原始8K的模型还是32K的模型,这个问题都很突出,能否优化一下啊?
-
支持chatglm2-6b-32k吗
-
-
bigdl-core-xe 2.4.0b20231101
bigdl-core-xe-esimd 2.4.0b20231101
bigdl-llm 2.4.0b20231101
-----------------------------------------------------
the second in…
-
### Environment:
MacOS M1 pro
### Model:
chatglm2-6b量化模型
### Error:
Run with docker
```
docker run -it --rm -v $PWD:/opt liplusx/chatglm.cpp:main \
./build/bin/main -m /opt/chatglm2-gg…
-
ChatGLM2-6B use multi-batch size by bigdl-llm[xpu] 20231016 on Arc 770 with Xeon.
For 32in/32out,instance=1, rest latency is 20.5ms/token.
For 32in/32out,instance=2, rest latency is 224.5ms/token.…
-
chatglm2和baichuan2都有这个问题。
1. 模型编译方式
from fastllm_pytools import llm
from transformers import AutoTokenizer, AutoModel
hf_model = "/workspace/chatglm2-6B"
flm_dtype = "int8"
model_name = hf_m…
-
### Description:
When I run sentiment example, the response result from chatglm is always '{\nsentiment : "xxx"\n}' which parse failed by JSON.Parse().
### Environment:
I used fastchat and chatglm2…