This pr cleans up the benchmark interface. The interface now is a dataclass with attributes train_dataset, test_dataset, and metrics. This pr additionally applies this interface to the sine benchmark.
Which issue does this PR tackle?
The benchmark interface could not handle multiple metrics.
The benchmark class does not have consistent attributes.
How does it solve the problem?
Changes Benchmark interface.
How are the changes tested?
Added Unittests.
Checklist for Contributors
[x] Scope: This PR tackles exactly one problem.
[x] Conventions: The branch follows the feature/title-slug convention.
[x] Conventions: The PR title follows the Bugfix: Title convention.
[x] Coding style: The code passes all pre-commit hooks.
[x] Documentation: All changes are well-documented.
[x] Tests: New features are tested and all tests pass successfully.
[x] Changelog: Updated CHANGELOG.md for new features or breaking changes.
[x] Review: A suitable reviewer has been assigned.
Checklist for Reviewers:
[ ] The PR solves the issue it claims to solve and only this one.
[ ] Changes are tested sufficiently and all tests pass.
Cleanup: Benchmark Interface
Description
This pr cleans up the benchmark interface. The interface now is a dataclass with attributes
train_dataset,test_dataset, andmetrics. This pr additionally applies this interface to the sine benchmark.Which issue does this PR tackle?
How does it solve the problem?
How are the changes tested?
Checklist for Contributors
feature/title-slugconvention.Bugfix: Titleconvention.Checklist for Reviewers: