-
when MMLU eval, same single GPU, it success:
lm_eval --model hf \
--model_args pretrained="Qwen/Qwen1.5-7B-Chat",dtype=bfloat16 \
--tasks mmlu \
--device cuda \
--batch_size 32 …
-
### 起始日期 | Start Date
_No response_
### 实现PR | Implementation PR
_No response_
### 相关Issues | Reference Issues
_No response_
### 摘要 | Summary
Hello, I would like to confirm what the form of fin…
-
Hello , Can LMFlow support Qwen1.5-1.8B model Fine-tuning?
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues.
### Operating system information
Linux
### P…
-
![094c99ee1cd6bcfd56a550c1a68d80c2](https://github.com/NVIDIA/TensorRT-LLM/assets/57712520/4cb57a97-bee3-4bc6-ab09-e6779f0fda76)
-
script
```sh
python run_safety_editing.py --editing_method=DINM --edited_model=Qwen1.5-7B --hparams_dir=./hparams/DINM/Qwen1.5-7B --safety_classifier_dir=zjunlp/SafeEdit-Safety-Classifier --metrics_…
-
### Describe the issue as clearly as possible:
When utilizing the Outliens VLLM mode for JSON and regex inference, the GPU utilization remains at 0%, while the CPU utilization peaks at 100%. What cou…
-
**例行检查**
[//]: # '方框内填 x 表示打钩'
- [x] 我已确认目前没有类似 issue
- [x] 我已完整查看过项目 README,以及[项目文档](https://doc.fastgpt.in/docs/intro/)
- [x] 我使用了自己的 key,并确认我的 key 是可正常使用的
- [x] 我理解并愿意跟进此 issue,协助测试和提供反馈
…
-
qwen1.5-7b-chat微调:
deepspeed --num_gpus 2 src/train_bash.py --deepspeed ./Qwen1.5/examples/sft/ds_config_zero2_new.json --stage sft --do_train --model_name_or_path './Qwen1.5-7B-Chat' --dataset huxij…
-
Qwen1.5 系列模型相较于Qwen1.0 从model.chat 变成了model.generate,那之前的history参数呢?我部署到本地的Qwen1.5-7B-chat都不能实现交互式回答问题,会遗忘掉之前的对话记录