CPT: update `save_optim_limit`, update 13B scripts

pjlab-sys4nlp / llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

https://arxiv.org/abs/2406.16554

Apache License 2.0

883 stars 46 forks source link

Closed Spico197 closed 1 year ago