search

AnswerDotAI / fsdp_qlora

Training LLMs with QLoRA + FSDP
Apache License 2.0
1.38k stars 185 forks source link

Results after running #50

Open hsb1995 opened 5 months ago

hsb1995 commented 5 months ago

image image image Why do I lose a lot of pre training weights after running, and how can I use the trained files for downstream tasks？