search

microsoft / CodeT

MIT License
599 stars 76 forks source link

Evaluation on HumanEval #8

Closed MT010104 closed 5 months ago

MT010104 commented 1 year ago

Hi, thanks for the great work! Whether the models were finetuned before using HumanEval, and whether the models and parameters can be provided?

zfj1998 commented 5 months ago

All the models used in CodeT, including CodeGen and InCoder were not finetuned or trained on any data. You can reproduce our results using their huggingface checkpoints