search

princeton-nlp / intercode

[NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
https://intercode-benchmark.github.io/
MIT License
194 stars 32 forks source link

Why are the leaderboards empty? #23

Closed zhimin-z closed 4 months ago

zhimin-z commented 5 months ago

image image Check https://intercode-benchmark.github.io/#ctf and https://intercode-benchmark.github.io/#swe

john-b-yang commented 4 months ago

Afaik, no one has submitted to these leaderboards.

I'll probably deprecate the SWE one soon. The idea behind that has taken on a life of its own in the form of the SWE-bench + SWE-agent projects.