-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
(Llama_Factory) PS D:\LLM\LLaMA-Factory> llamafactory-cli env
bin D:\conda\envs\Llama_Factory\lib\site…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
训练的脚本为:deepspeed --num_gpus 4 src/train_bash.py \
--deepspeed ds_config.json \
--stage dpo \
…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
1.在4090×2上训练的checkpoint,per_device_train_batch_size=2,gradient_accumulation_steps=8,换到A100 40G×4机器…
-
I need to raise an issue regarding using llama.cpp for inference with qwen1.5.
When using the official weights provided by qwen, the inference works fine:
(llama.cpp) root@8411db7a5b9f:~/llama.c…
-
### **Background:**
TT-Buda model demos, developed by Tenstorrent, is a growing collection of model demos showcasing the capabilities of AI models running on Tenstorrent hardware. These demonstration…
-
## ❓ General Questions
I use these json, but meet some problems. So how to set model_lib?
The problems I meet is the same as: https://github.com/mlc-ai/mlc-llm/issues/1517
```
{
"model_list":…
-
I try to modify train script `examples/pytorch/llm/scripts/qwen_7b_chat/lora_ddp_ds/sft.sh` in `examples` folder with more CUDA_VISIBLE_DEVICES
``` bash
export CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
`python src/api_demo.py \
--model_name_or_path /Qwen1.5-MoE-A2.7B-Chat \
--adapter_name_or_pat…
-
你好,我在运行你的代码时,出现了如下错误:
`openai.BadRequestError: Error code: 400 - {'object': 'error', 'message': "[{'type': 'extra_forbidden', 'loc': ('body', 'tools'), 'msg': 'Extra inputs are not permitted', 'input…
-
when MMLU eval, same single GPU, it success:
lm_eval --model hf \
--model_args pretrained="Qwen/Qwen1.5-7B-Chat",dtype=bfloat16 \
--tasks mmlu \
--device cuda \
--batch_size 32 …