TencentARC / LLaMA-Pro

[ACL 2024] Progressive LLaMA with Block Expansion.
https://tencentarc.github.io/LLaMA-Pro/
Apache License 2.0
449 stars 34 forks source link

Pretrain code of Mistral-Pro-8B-v0.1 #22

Open shawnricecake opened 3 months ago

shawnricecake commented 3 months ago

Hi, I would like to know when the pretrain code will be released?

hills-code commented 3 months ago

It is expected to be released by this month! Thanks for your attention!