Benchmark Submission: mallamanis

github / CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.

https://arxiv.org/abs/1909.09436

MIT License

2.18k stars 385 forks source link

Benchmark Submission: mallamanis #198

Closed mallamanis closed 4 years ago

mallamanis commented 4 years ago

This pull request represents a submission to the codesearchnet benchmark.

It is the main communication channel for you and the reviewers.

Wandb run results for review

mallamanis commented 4 years ago

This is an update to the baseline 1D-CNN model, based on @novoselrok observation about indexing. This sets n_trees=200 for indexing and improves the previous NDCG from 0.108 to 0.165 (still under-performing compared to NBoW).

(related to #197)