naamiinepal / xrayto3D-benchmark

GNU General Public License v3.0
9 stars 3 forks source link

obtain model performance variability by running multiple seeds #10

Open msrepo opened 1 year ago

msrepo commented 1 year ago
Tasks
msrepo commented 1 year ago

Finalize what models are we going to put in the final table before running these expensive multiple folds. For example it was found that SwinUNETR does considerably well than UNETR(kind of obvious, given it is essentially an improvement over UNETR using shifted window) i.e. we might keep SwinUNETR instead of UNETR as representative of the best pure transformer model.

msrepo commented 1 year ago

See https://github.com/mle-infrastructure/mle-logging for reference. there aggregate_over_seed() aggregates dicts.

files

current workflow rect815

python scripts/generate_train_val_test_paths.py configs/full/Verse2019-DRR-full.yaml

TODO