kaiko-ai / eva

Evaluation framework for oncology foundation models (FMs)
https://kaiko-ai.github.io/eva/
Apache License 2.0
66 stars 4 forks source link

Add `N_DATA_WORKERS` env variable to make dataloader `num_workers` configurable #680

Closed nkaenzig closed 1 month ago

nkaenzig commented 1 month ago

Closes #679

Using a new default of 4 workers, as for most datapipelines speed doesn't seem to improve by increasing the worker count further.