princeton-nlp / SWE-bench

[ICLR 2024] SWE-bench: Can Language Models Resolve Real-world Github Issues?
https://www.swebench.com
MIT License
2k stars 348 forks source link

allow for subscription to top of leaderboard change on the website (email). #227

Closed RealmX1 closed 3 weeks ago

RealmX1 commented 1 month ago

Describe the feature

as described

Potential Solutions

trivial

Another good idea is to have official SWE-bench social account posting leaderboard change

john-b-yang commented 3 weeks ago

Hi @RealmX1 thanks for the suggestion. I just tweeted a leaderboard update - I'll likely keep doing this on a monthly or bi-weekly basis.

If we set up a subscription service, I'll post here. Closing this PR for now.