search

eth-easl / modyn

Modyn is a research-platform for training ML models on dynamic datasets.
MIT License
22 stars 3 forks source link

Windowing for data drift detection #557

Closed MaxiBoether closed 5 days ago

MaxiBoether commented 5 days ago

This changes the way we build the reference and current data windows in drift detection: We implement amount- and time-based windowing that is independent of triggering.

github-actions[bot] commented 5 days ago

Line Coverage: -% ( % to main) Branch Coverage: -% ( % to main)

robinholzi commented 5 days ago

I'll check this out later today! Thanks for this first draft!

codecov[bot] commented 5 days ago

Codecov Report

Attention: Patch coverage is 91.42857% with 6 lines in your changes missing coverage. Please review.

Project coverage is 82.95%. Comparing base (c6622d3) to head (e7ffe9f).

Files Patch % Lines
...n/supervisor/internal/triggers/datadrifttrigger.py 88.67% 6 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #557 +/- ## ========================================== + Coverage 82.89% 82.95% +0.06% ========================================== Files 226 226 Lines 10419 10444 +25 ========================================== + Hits 8637 8664 +27 + Misses 1782 1780 -2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.