-
I have tried this on Arch Linux with vendor 6.1.(unsure)\
And Armbian with vendor 6.1.43
mike@rock-5a:~/qwen-1_8B-rk3588$ rkllm ./qwen-chat-1_8B.rkllm
RKLLM starting, please wait...
rkllm-runti…
-
### Confirm this is an issue with the Python library and not an underlying OpenAI API
- [X] This is an issue with the Python library
### Describe the bug
response = client.chat.completions.create(
…
-
### What happened?
I ran the Ollama model on the local server and set my brain to the Ollama model. However, I encountered a problem while chatting with my brain.
Due to the inability to directly co…
-
**例行检查**
[//]: # '方框内填 x 表示打钩'
- [ ] 我已确认目前没有类似 issue
- [ ] 我已完整查看过项目 README,以及[项目文档](https://doc.fastgpt.in/docs/intro/)
- [ ] 我使用了自己的 key,并确认我的 key 是可正常使用的
- [ ] 我理解并愿意跟进此 issue,协助测试和提供反馈
…
-
When I run local llm qwen-72b-chat, it can`t work normal, it will be stuck like this:
![image](https://github.com/vllm-project/vllm/assets/68416779/dee72595-700a-4085-9a6f-a1527b8f5362)
**Command**
…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
python src/api.py --model_name_or_path /data/models/LLM_models/qwen/Qwen-72B-Chat-Int4 --template qwen …
-
**问题描述 / Problem Description**
调用讯飞星火api时,无论是LLM对话,还是知识库问答,都没有输出回答。但命令行也没有显示报错
**预期的结果 / Expected Result**
![image](https://github.com/chatchat-space/Langchain-Chatchat/assets/142043181/6dbb1402-…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
我用0.4.0的版本跑qwen110b的模型一直报错内存不…
-
- [ ] [LoRA Land: Fine-Tuned Open-Source LLMs that Outperform GPT-4 - Predibase - Predibase](https://predibase.com/blog/lora-land-fine-tuned-open-source-llms-that-outperform-gpt-4)
# LoRA Land: Fine…
-
Hi, I am trying to finetune LLaVA-NeXT with my custom dataset, using "finetune_clip.sh" shell file.
I gave some edits to the shell for my convenience and to satisfy my task so far, like this:
```
…