初步完成了多轮对话模型的指令微调 - Githubissues

baichuan-inc / Baichuan-7B

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

https://huggingface.co/baichuan-inc/baichuan-7B

Apache License 2.0

5.67k stars 506 forks source link

初步完成了多轮对话模型的指令微调 #70

Open xiaotinghe opened 1 year ago

xiaotinghe commented 1 year ago

Required prerequisites

[X] I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
[X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
[X] Consider asking first in a Discussion.

Questions

已经发布到huggingface。使用了私有对话数据。

https://huggingface.co/csdc-atl/baichuan-7B-chat

仍然需要遵循baichuan-7B的要求。如果将baichuan-7B衍生品用作商业用途，需要联系百川团队。

Checklist

[X] I have provided all relevant and necessary information above.
[X] I have chosen a suitable title for this issue.

fenglinbei commented 1 year ago

感谢感谢

jiacheo commented 1 year ago

能否提供下微调的代码？以及数据集的样例。

xiaotinghe commented 1 year ago

能否提供下微调的代码？以及数据集的样例。

微调代码修改自https://github.com/ymcui/Chinese-LLaMA-Alpaca/tree/main/scripts/training 数据集样例随后发到huggingface页面

xxm1668 commented 1 year ago

有和chatglm做对比吗？

Trangle commented 1 year ago

词表大小都改了，为了适配那个?