eth-easl / modyn

Modyn is a research-platform for training ML models on dynamic datasets.
MIT License
22 stars 3 forks source link

fix: Allow to ignore certain assertion errors #545

Closed robinholzi closed 2 weeks ago

robinholzi commented 2 weeks ago

Motivation

Sometimes a minimal number of evaluation requests are missing due to undetermined reasons. We want to allow manual inspection during aggregation with the option to ignore certain validation errors.

codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 82.81%. Comparing base (97a2b5f) to head (863afd5).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #545 +/- ## ======================================= Coverage 82.81% 82.81% ======================================= Files 217 217 Lines 10152 10152 ======================================= Hits 8407 8407 Misses 1745 1745 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

github-actions[bot] commented 2 weeks ago

Line Coverage: -% ( % to main) Branch Coverage: -% ( % to main)