microsoft / hi-ml

HI-ML toolbox for deep learning for medical imaging and Azure integration
https://aka.ms/hi-ml
MIT License
269 stars 60 forks source link

ENH: Ability to evaluate model on a new dataset #859

Closed ant0nsc closed 1 year ago

ant0nsc commented 1 year ago

Renamed the MLRunner to TrainingRunner. Introduced a new EvalRunner. Shared functionality moved from MLRunner to RunnerBase.

codecov[bot] commented 1 year ago

Codecov Report

Merging #859 (a2cf88b) into main (0ed16e3) will decrease coverage by 10.51%. The diff coverage is 85.29%.

Impacted file tree graph

Flag Coverage Δ
hi-ml 83.00% <85.29%> (+0.29%) :arrow_up:
hi-ml-azure 25.40% <ø> (+0.17%) :arrow_up:
hi-ml-cpath 49.01% <ø> (-24.15%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
hi-ml-azure/src/health_azure/datasets.py 36.17% <ø> (+0.27%) :arrow_up:
hi-ml/src/health_ml/lightning_container.py 80.17% <50.00%> (+0.34%) :arrow_up:
hi-ml/src/health_ml/runner.py 86.88% <73.33%> (-0.62%) :arrow_down:
hi-ml/src/health_ml/runner_base.py 80.39% <80.39%> (ø)
hi-ml/src/health_ml/__init__.py 100.00% <100.00%> (ø)
hi-ml/src/health_ml/configs/hello_world.py 87.40% <100.00%> (+0.40%) :arrow_up:
hi-ml/src/health_ml/eval_runner.py 100.00% <100.00%> (ø)
hi-ml/src/health_ml/experiment_config.py 100.00% <100.00%> (ø)
hi-ml/src/health_ml/training_runner.py 77.39% <100.00%> (ø)

... and 63 files with indirect coverage changes