How to run 13B LLaMA model for Full-parameters SFT ?

AetherCortex / Llama-X

Open Academic Research on Improving LLaMA to SOTA LLM

Apache License 2.0

1.58k stars 101 forks source link

Open jacklanda opened 1 year ago

jacklanda commented 1 year ago

Is there anybody can provide a running command example for LLaMA-13B model Full-parameters SFT?

Btw, I gonna run this experiment on 8 * A100-80GB hardware envs.

Thanks so much!