I was reviewing the notebooks and in the fine-tuning tutorials we do not do the prompt formatting with [INST], and other special tokens. I understand that we are free to chose any prompt template in case of fine-tuning the text-completion model. But in case of tuning the instruct model, should we follow the same prompt formatting as Meta recommend?
Hello!
I was reviewing the notebooks and in the fine-tuning tutorials we do not do the prompt formatting with [INST], and other special tokens. I understand that we are free to chose any prompt template in case of fine-tuning the text-completion model. But in case of tuning the instruct model, should we follow the same prompt formatting as Meta recommend?