issues
search
aai-institute
/
nnbench
A small framework for benchmarking machine learning models.
https://aai-institute.github.io/nnbench/
Apache License 2.0
10
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Bump oldest supported Python to 3.10
#147
nicholasjng
closed
2 days ago
0
Safe setting of CPU Info
#146
maxmynter
closed
2 months ago
0
macOS test failure due to GitHub Apple Silicon oddities
#145
maxmynter
closed
2 months ago
0
Add nnbench video to readme
#144
maxmynter
closed
2 months ago
1
Explore a CLI workflow for usage in ML pipelines and CI
#143
nicholasjng
opened
6 months ago
0
Stabilize the record IO interface
#142
nicholasjng
opened
6 months ago
0
Add small parameter representation guide for the benchmark runner
#141
nicholasjng
opened
6 months ago
0
Add `transform` slot to record IO types
#140
nicholasjng
opened
6 months ago
0
(fix) Change default == value to is
#139
maxmynter
closed
6 months ago
0
Investigate binding params to benchmarks with weakrefs
#138
nicholasjng
opened
6 months ago
0
Implement memo garbage collection
#137
nicholasjng
closed
6 months ago
0
Update dev requirements, add Memray artifacts to gitignore
#136
nicholasjng
closed
6 months ago
0
Organize `nnbench.types.types` into different files
#135
maxmynter
closed
6 months ago
0
Add memo followups to the user guide
#134
nicholasjng
closed
6 months ago
0
Update HuggingFace example to use memoization
#133
nicholasjng
closed
6 months ago
0
Hint all `name` arguments as `str` only
#132
nicholasjng
closed
6 months ago
1
Supplying `nnbench.Transform`s directly to record IO
#131
nicholasjng
opened
6 months ago
0
Add global memo cache and integrate with the setUp and teardown injection
#130
maxmynter
closed
6 months ago
1
Add new memoization guide
#129
nicholasjng
closed
6 months ago
1
Update Artifact Tutorial
#128
Maciej818
closed
6 months ago
0
State injection into setup and teardown
#127
maxmynter
closed
6 months ago
0
Add global memo cache and eviction API
#126
nicholasjng
closed
6 months ago
0
Add `nnbench.State` object holding current benchmark information, inject into setup/teardown tasks
#125
nicholasjng
closed
6 months ago
0
Add transform submodule, parameter compression transform
#124
nicholasjng
closed
6 months ago
0
Rollforward of lakefs-spec doc changes
#123
nicholasjng
closed
6 months ago
0
Parameter representations instead of parameters in benchmark records
#122
nicholasjng
closed
6 months ago
3
Enhance API Reference Documentation for nnbench
#121
leonpawelzik
closed
6 months ago
1
Feature: Thunks as an alternative to artifacts
#120
nicholasjng
closed
6 months ago
0
Check loaded module names before importing a new one from a file
#119
nicholasjng
closed
6 months ago
1
Make `Transform` an abstract base class, delete iapply method ...
#118
nicholasjng
closed
6 months ago
0
Improve base `Transform` interface
#117
nicholasjng
closed
6 months ago
0
`functools.partial`ize the `nnbench.parametrize` decorators.
#116
maxmynter
closed
6 months ago
1
Module path construction causes typecheck fails
#115
nicholasjng
closed
6 months ago
0
Redesign artifact concept
#114
nicholasjng
closed
6 months ago
1
Add transform proposal
#113
nicholasjng
closed
6 months ago
1
Unique keys
#112
maxmynter
closed
6 months ago
0
Inline the `_cleanup` function for the `FilePathArtifactLoader`.
#111
maxmynter
closed
6 months ago
2
Add checksum verification to artifacts and loaders
#110
nicholasjng
closed
6 months ago
3
Remove the `ArtifactCollection` class
#109
maxmynter
closed
6 months ago
0
Remove `ArtifactCollection` Wrapper
#108
maxmynter
closed
6 months ago
0
Add Artifacts guide
#107
maxmynter
closed
6 months ago
0
Docs: Versioning considerations
#106
AdrianoKF
opened
6 months ago
0
Set up best practice for easy record serialization + parametrization + reproducibility
#105
nicholasjng
closed
6 months ago
1
Run pre-commit autoupdate, bump dependencies
#104
nicholasjng
closed
6 months ago
0
Add Parameters to Benchmarks
#103
maxmynter
closed
6 months ago
0
Hotfix: Adjust snippet paths
#102
nicholasjng
closed
6 months ago
1
Benchmark results do not contain parameters
#101
nicholasjng
closed
6 months ago
0
Implement a FSspec based ArtifactLoader
#100
maxmynter
closed
6 months ago
0
Improve ensure unique keys in `Contexts` upon merge.
#99
maxmynter
closed
6 months ago
0
Add a lightning demo to the README.md
#98
nicholasjng
closed
7 months ago
3
Next