search

jianzhnie / LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
https://jianzhnie.github.io/llmtech/
Apache License 2.0
561 stars 61 forks source link

8bit和4bit训练效果对比有吗 #8

Open kongjiellx opened 1 year ago

kongjiellx commented 1 year ago

如题，想知道8bit和4bit qlora效果有没有差别？

jianzhnie commented 1 year ago

还没有做过对比，这个你可以尝试一下哦