baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc
Apache License 2.0
4.08k stars 293 forks source link

Baichuan2-13B-Base全量微调问题 #323

Open xiaocangsheng opened 9 months ago

xiaocangsheng commented 9 months ago

Baichuan2-13B-Base进行全参微调的最低配置是什么?以belle_chat_ramdon_10k.json数据集为例,求个大佬解答下

baichuan-assistant commented 9 months ago

可参考: https://github.com/hiyouga/LLaMA-Factory?tab=readme-ov-file#requirement