loubnabnl / santacoder-finetuning

Fine-tune SantaCoder for Code/Text Generation.
Apache License 2.0
179 stars 22 forks source link

FIM Evaluation #26

Closed Hambaobao closed 4 months ago

Hambaobao commented 4 months ago

Hello, thanks a lot for your great work. Could you kindly advise on how to replicate the evaluation results of FIM as shown in Table 6 of your paper? I've been searching for the evaluation code for quite some time but haven't been able to find it.

Xnip2024-02-29_21-19-23