-
使用ollama部署qwen:7b模型,使用项目中function_calling.py的demo测试,测试结果如下:
![function-calling-test-result-1](https://github.com/QwenLM/Qwen-Agent/assets/47100639/0feb27a5-97c7-477a-a32e-e38bd0efa112)
![function-ca…
-
Qwen1.5 系列模型相较于Qwen1.0 从model.chat 变成了model.generate,那之前的history参数呢?我部署到本地的Qwen1.5-7B-chat都不能实现交互式回答问题,会遗忘掉之前的对话记录
-
首先感谢千问团队优秀的工作!
代码库中找到了量化相关的文档,比如[gptq](https://github.com/QwenLM/Qwen1.5/blob/main/docs/source/quantization/gptq.rst),但是开源出来的量化版本(譬如 [Qwen1.5-72B-Chat-GPTQ-Int4](https://huggingface.co/Qwen/Qwen1.5…
-
How to batch inference for lora
-
![image](https://github.com/QwenLM/Qwen/assets/28916374/837f1084-69d1-4765-82a9-0d8ec14f3213)
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
如题:命令如下
deepspeed --num_gpus 2 src/train_bash.py \
--deepspeed ./examples/deepspeed/ds_z3…
-
Do you have plans to support Qwen Lora?
-
I'm trying to open a checkpoint that was saved from huggingface but it fails
```
model = AutoModelForCausalLM.from_pretrained('Qwen/Qwen1.5-0.5B')
model.save_pretrained("testmodel")
```
Then wh…
-
### 环境
镜像:ngc24.02
代码:commid id:1f3c6fc07750dee17d8eba5b0d9c64b66569101f
数据:wget https://atp-modelzoo-wlcb-pai.oss-cn-wulanchabu.aliyuncs.com/release/models/pai-megatron-patch/llama3-datasets/wudao…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
Package Version
------------------------- --------------------
accelerate …