search

TencentARC / LLaMA-Pro

[ACL 2024] Progressive LLaMA with Block Expansion.
https://tencentarc.github.io/LLaMA-Pro/
Apache License 2.0
449 stars 34 forks source link

full code to continue pre-training #6

Open Abolfazl-kr opened 6 months ago

Abolfazl-kr commented 6 months ago

could you please give us full code to train the LLaMA-Pro?

hills-code commented 6 months ago

I have uploaded the training code to this repo. You can also check https://github.com/hills-code/open-instruct/tree/llama-pro.