eth-easl / modyn

Modyn is a research-platform for training ML models on growing datasets.
MIT License
25 stars 3 forks source link

Support for RS2 at the Selector instead of downsampling #466

Open MaxiBoether opened 3 months ago

MaxiBoether commented 3 months ago

In #465, we implement RS2 sampling, which does not need any information from the forward pass. However, the actual training data in RS2 changes each epoch, which the selector currently does not support. We fitted the implementation to the downsampling case, but actually it might be better to extend the selector component to allow updating the TTS if no information from model forward pass is required, since the definition of downsampling more or less is using information from the forward pass.