search

eth-easl / modyn

Modyn is a research-platform for training ML models on growing datasets.
MIT License
22 stars 3 forks source link

Move `after_pipeline|training_evaluation_workers` to pipeline config #508

Closed MaxiBoether closed 1 month ago

MaxiBoether commented 1 month ago

Instead of configuring this on a modyn config level, it might be helpful to have this on a pipeline level. For example, on the same Modyn instance, right now I have yearbook and CGLM running. I can evaluate a lot more yearbook models in parallel than CGLM models. Hence it would be great to have this on a pipeline level instead.

XianzheMa commented 1 month ago

Now working on it

MaxiBoether commented 1 month ago

Thanks for fixing that!