Gemma finetuning formatting

google / gemma_pytorch

The official PyTorch implementation of Google's Gemma models

https://ai.google.dev/gemma

Apache License 2.0

5.19k stars 492 forks source link

Gemma finetuning formatting #60

Open mostafamdy opened 3 months ago

mostafamdy commented 3 months ago

Hi, I'm a bit confused. Should I use Gemma formatting tags during fine-tuning https://ai.google.dev/gemma/docs/formatting , or should I use this template: 'Instruction:\n{instruction}\n\nResponse:\n{response}' I found this template in many notebooks