kotoba-tech / kotoba-recipes

Support Continual pre-training & Instruction Tuning forked from llama-recipes
https://zenn.dev/kotoba_tech/articles/202d2ff862a1db
32 stars 4 forks source link

LLM Continual Pre-Training #3

Open tmsnvd opened 9 months ago

tmsnvd commented 9 months ago

Hi :) really really interested in this topic, looking forward for documentation. Thanks for sharing! 🙏

okoge-kaz commented 9 months ago

We’ll prepare the docs shortly. 🙏

capihacendado commented 9 months ago

Thanks for sharing! looking forward for the docs! thank you!

smyja commented 8 months ago

Will the docs be different from what's here https://medium.com/@kaz.tokyo.tech20/kotoba-recipes-library-5-minutes-to-start-llama-2-continual-learning-5f95c244a566