what is the sft template？

bigcode-project / starcoder2

Home of StarCoder2!

Apache License 2.0

1.76k stars 158 forks source link

what is the sft template？ #9

Open OKC13 opened 7 months ago

OKC13 commented 7 months ago

what is the sft template？ when i try to use this model, i dont know what is the sft template. please help me, thankyou

loubnabnl commented 7 months ago

Hi these are based models that didn't go through SFT, so you can choose whatever format you want. You can also experiment with some of the formats included in pre-training like issues (we have found that it works well for bug fixing)