Leaderboard

[korneelf1]

Leaderboard

TODO: Add submission guidelines, we should discuss in next meeting.

[jasonlyik]

Looks great, we can clear this probably on Monday/Tuesday together.

A couple notes from my side:

• [ ] submission instructions, for now I guess can be PR to this table
• [ ] add links to leaderboard at the top to click quickly to certain task
• [x] table edit, like adding publication / author associated with the model
• [ ] add leaderboard to website
• [ ] try to remove the dvs gesture stuff from this PR if possible
• [ ] verify that the numbers are correct between the paper results and these tables

[jasonlyik]

Notes:

• [x] Change leaderboard to md file from rst
• [ ] Include in website neurobench.ai (a github.io site), in addition / rather than here in this repo
• [ ] TODO: can the website repo point to the md file from this repo? (github submodule?)
• [ ] Move website repo into organization instead of account?
• [ ] How should results be submitted? PR with table filled in for new results?

[ben9809]

@jasonlyik I found this interesting package that renders ".MD" files https://www.npmjs.com/package/react-markdown/v/8.0.6 https://github.com/remarkjs/react-markdown

[jasonlyik]

Setup neurobench/leaderboard dir Leaderboards for each of the benchmarks

Sortable tables? Maybe possible

Include BioCAS results in the Neural Decoding challenge (look at Scoreboard): http://1.117.17.41/neural-decoding-grand-challenge/

[jasonlyik]

@korneelf1 Here's the preprints for the biocas challenge winners

https://arxiv.org/abs/2409.01762 https://arxiv.org/abs/2410.22283 https://arxiv.org/abs/2409.04428