microsoft / CodeBERT

CodeBERT
MIT License
2.09k stars 430 forks source link

Sharing human evaluation results for CodeReviewer (informativeness and relevance) #303

Open atharva-naik opened 8 months ago

atharva-naik commented 8 months ago

Have the human evaluations of the system-generated code reviews from the paper (screenshot attached) been released somewhere? image

atharva-naik commented 8 months ago

@celbree @guody5 Could you please let me know if this information is available?

celbree commented 8 months ago

Hi, we don't release the human evaluation files, but only the results.

atharva-naik commented 8 months ago

@celbree is it possible to share the human evaluation files?