-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
CUDA_VISIBLE_DEVICES=0 API_PORT=9092 python src/api_demo.py \
--model_name_or_path /save_model/qwen1…
-
-
模型配置文件(例如Qwen1.5-7B-Chat中的[config.json](https://huggingface.co/Qwen/Qwen1.5-7B-Chat/blob/main/config.json))中,bos_token_id为151643:`"bos_token_id": 151643`
![image](https://github.com/QwenLM/Qwen1.5/as…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
I use the script:
`llamafactory-cli api --model_name_or_path Qwen/Qwen1.5-7B-Chat --template qwen`
de…
-
## 🐛 Bug
I used qwen1.5 1.8b to fine-tune the model and wanted to use mlc to deploy inference. During the test, I found that even with the q0f32 parameter without quantization, the accuracy of the te…
-
### 起始日期 | Start Date
_No response_
### 实现PR | Implementation PR
实现最新模型的部署
### 相关Issues | Reference Issues
_No response_
### 摘要 | Summary
部署最新大模型
### 基本示例 | Basic Example
。
### 缺陷 | Drawback…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…