Leaderboard - Githubissues

NeuroBench / neurobench

Benchmark harness and baseline results for the NeuroBench algorithm track.

https://neurobench.readthedocs.io

Apache License 2.0

46 stars 11 forks source link

Open korneelf1 opened 2 months ago

korneelf1 commented 2 months ago

Leaderboard

TODO: Add submission guidelines, we should discuss in next meeting.

jasonlyik commented 2 months ago

Looks great, we can clear this probably on Monday/Tuesday together.

A couple notes from my side:

[ ] submission instructions, for now I guess can be PR to this table
[ ] add links to leaderboard at the top to click quickly to certain task
[x] table edit, like adding publication / author associated with the model
[ ] add leaderboard to website
[ ] try to remove the dvs gesture stuff from this PR if possible
[ ] verify that the numbers are correct between the paper results and these tables

jasonlyik commented 2 months ago

Notes:

[ ] Change leaderboard to md file from rst
[ ] Include in website neurobench.ai (a github.io site), in addition / rather than here in this repo
[ ] TODO: can the website repo point to the md file from this repo? (github submodule?)
[ ] Move website repo into organization instead of account?
[ ] How should results be submitted? PR with table filled in for new results?

ben9809 commented 2 months ago