Alpha-VLLM / LLaMA2-Accessory

An Open-source Toolkit for LLM Development
https://llama2-accessory.readthedocs.io/
Other
2.61k stars 167 forks source link

About train SPHINX-X #162

Open becauseofAI opened 4 months ago

becauseofAI commented 4 months ago

How to train the SPHINX-X-series model? SPHINX-X-series includes SPHINX-Tiny, SPHINX-Intern2, SPHINX-Plus, SPHINX-MoE. Train includes Pretrain and SFT. Can you provide description of training process and training script? @tmm1 @lupantech @csuhan @jiangzhengkai @eltociear