llama2-13B和llama2-70b微调所需要的显卡配置

jianzhnie / LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

https://jianzhnie.github.io/llmtech/

Apache License 2.0

547 stars 60 forks source link

Open batindfa opened 11 months ago

batindfa commented 11 months ago

您好！请问有推荐的配置吗？

jianzhnie commented 11 months ago

llama2-13B 最低配置 24G 显卡， llama2-70b 还没测试过