github / CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.
https://arxiv.org/abs/1909.09436
MIT License
2.18k stars 385 forks source link

999 distractor snippets #214

Closed ncshrikanth closed 4 years ago

ncshrikanth commented 4 years ago

Thank You for CodeSearchNet. A quick question: if we wish to replicate Table 3 (of your paper) where can we find the 999 distractor snippets and how did you form those 999 snippets?

Zamony commented 4 years ago

Hi, @ncshrikanth! As far as I can tell, they were generated randomly: https://github.com/github/CodeSearchNet/blob/e792e1caea20fbd4fba439565fe20c10d4798435/src/model_test.py#L58

ncshrikanth commented 4 years ago

I see, thanks @Zamony !