philschmid / sagemaker-huggingface-llama-2-samples

87 stars 32 forks source link

Does we need the prompt formatting during the instruct model fine-tuning? #18

Open mariababich opened 1 year ago

mariababich commented 1 year ago

Hello!

I was reviewing the notebooks and in the fine-tuning tutorials we do not do the prompt formatting with [INST], and other special tokens. I understand that we are free to chose any prompt template in case of fine-tuning the text-completion model. But in case of tuning the instruct model, should we follow the same prompt formatting as Meta recommend?