search

deepseek-ai / DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself
https://coder.deepseek.com/
MIT License
6.6k stars 461 forks source link

Finetune of FIM #123

Open shatealaboxiaowang opened 7 months ago

shatealaboxiaowang commented 7 months ago

Hi, dear:

I see that the data format you mentioned is all <instuction, output> format, Have you finetune the model for FIM? Dose finetune only with instruction can also improve FIM's performance ??

Look forward to hearing from you.

mikelpzm commented 7 months ago

Same question here, I haven't seen an "official" example on how to properly finetune any FIM model.

rautnavnath commented 7 months ago

I too, am waiting for any examples for FIM on base model.

greenEggLy commented 5 months ago

@guoday @pkuzqh Could you plz provide some examples? Also confused about how to build FIM fine-tune dataset. Thanks❤️

wentinghome commented 4 months ago

yes, looking forward to examples.