Metrics Upgrades - Githubissues

NeuroBench / neurobench

Benchmark harness and baseline results for the NeuroBench algorithm track.

https://neurobench.readthedocs.io

Apache License 2.0

64 stars 13 forks source link

Metrics Upgrades #226

Open jasonlyik opened 4 months ago

jasonlyik commented 4 months ago

Running issue for metrics upgrades:

Increasing unittest coverage:

Tests for synops LSTMCell, RNNCell, GRUCell should include batch size > 1

Features / Modularization:

Connection sparsity pull out long if/elif statement to separate functions
Hooks are only added specifically for the metrics that need them

ben9809 commented 3 months ago

@SreyesVenkatesh, @jasonlyik I found this codecov.io tool to give a better overview of the code covered by the unit tests. Once implemented it will be beneficial to extend our unit tests.

ben9809 commented 3 months ago

https://app.codecov.io/gh/NeuroBench/neurobench Here you can find the report