search

AnswerDotAI / fsdp_qlora

Training LLMs with QLoRA + FSDP
Apache License 2.0
1.42k stars 188 forks source link

llama3? #53

Open lianuo opened 6 months ago

lianuo commented 6 months ago

Now we have llama3 , what else should we pay attention to if we fine-tune it?