search

microsoft / CodeXGLUE

CodeXGLUE
MIT License
1.5k stars 363 forks source link

leaderboard POJ clone detection #150

Open xieexiaotuzi opened 1 year ago

xieexiaotuzi commented 1 year ago

Hi, Thanks for sharing such great dataset for code research.

I am confused about the leaderboard on POJ clone detection. I saw the correct answer of test set and evaluation script on the git repo. So  is this different from  "we do not release the correct answers for test set to the public" (from the CodeXGLUE Submission Instructions  on https://microsoft.github.io/CodeXGLUE/ ). Is the test data used in the leaderboard different from the data on git repo and paper?

Thanks a lot. Best LJ.

celbree commented 1 year ago

For some dataset we don't release the correct answer. For other datasets that have been published before, the correct answer can be contained in our benchmark.