[Question] 使用QLoRA+百万指令数据，单卡高效微调baichuan-7B

[yangjianxin1]

Required prerequisites

• [X] I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
• [X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• [ ] Consider asking first in a Discussion.

Questions

使用QLoRA+百万指令数据，单卡高效微调baichuan-7B模型。

项目地址：https://github.com/yangjianxin1/Firefly QLoRA-baichuan-7b模型权重：https://huggingface.co/YeungNLP/firefly-baichuan-7b-qlora-sft 百万中文多轮指令数据：https://huggingface.co/datasets/YeungNLP/moss-003-sft-data

生成效果：

Checklist

• [X] I have provided all relevant and necessary information above.
• [X] I have chosen a suitable title for this issue.

[Nisoka]

@yangjianxin1 好厉害的效果，请问大神用的什么样的机器，跑了多久？如果13B的话最低需要什么样的配置 进行QLora训练