search

Project-MONAI / tutorials

MONAI Tutorials
https://monai.io/started.html
Apache License 2.0
1.76k stars 664 forks source link

Adding evidence of performance improvement by using test-time augmentation (TTA) in the tutorial notebook #191

Open dongyang0122 opened 3 years ago

dongyang0122 commented 3 years ago

Current tutorial notebook about test-time augmentation (TTA) simply shows how to apply it for brain MRI segmentation in 2D planes. However, it is unclear the if the TTA method would improve the segmentation quality in practice. https://github.com/Project-MONAI/tutorials/blob/master/modules/inverse_transforms_and_test_time_augmentations.ipynb

It is better to show the accuracy and quality (visual) improvement of segmentation masks and let users know how to properly apply the TTA method in practice boosting the performance.

Nic-Ma commented 3 years ago

Hi @rijobro ,

Could you please help take a look when you are back?

Thanks.

rijobro commented 3 years ago

Hi @dongyang0122 are you saying you'd like a comparison between the inference of a single image versus the mode of multiple random instances computed with TTA?

dongyang0122 commented 3 years ago

My point is to justify the usage of TTA in practice. It would be nice to show the segmentation improvement in terms of accuracy and appearance.

ahatamiz commented 3 years ago

Hi @rijobro

I tried to use this TTA implementation for a segmentation application. After reading the source code, it turns out it expects raw input data dictionary as opposed to a PyTorch tensors ? ideally this is a post-transform which should also accept PyTorch tensors and then apply additional transforms.

I also agree with @dongyang0122. The tutorial can be improved by including a 3D use-case.