microsoft / CodeXGLUE

CodeXGLUE
MIT License
1.51k stars 363 forks source link

Test set ground truth is empty #102

Closed urialon closed 2 years ago

urialon commented 2 years ago

Hi, All the 'gt' fields in the test set of CodeCompletion-Line are empty, am I missing something?

https://github.com/microsoft/CodeXGLUE/blob/main/Code-Code/CodeCompletion-line/dataset/javaCorpus/line_completion/test.json

Thanks, Uri

celbree commented 2 years ago

Hi, we don't provide the ground truth of test set in line completion task. Feel free to submit your predictions to codexglue@microsoft.com and we will give you results!

urialon commented 2 years ago

Got it, thanks!

On Wed, Feb 23, 2022 at 22:09 Shuai Lu @.***> wrote:

Hi, we don't provide the ground truth of test set in line completion task. Feel free to submit your predictions to @.*** and we will give you results!

— Reply to this email directly, view it on GitHub https://github.com/microsoft/CodeXGLUE/issues/102#issuecomment-1049450620, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADSOXMFZO37UXHTQ2GGG343U4WOQJANCNFSM5PCKXFSQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>