pretrain llama-2 - Githubissues

philschmid / sagemaker-huggingface-llama-2-samples

87 stars 32 forks source link

pretrain llama-2 #12

Open enpassanty opened 1 year ago

enpassanty commented 1 year ago

Hi, I want to pre-train llama-2 with my custom dataset starting from the published checkpoint before fine-tuning. can you recommend/add a script for this? thank you!