I recently ran into a situation where one modality in one data group in one case out of a hundred cases had an extra dimension. Particularly, a FLAIR sequence had two time-points. This caused an error in patch extraction, as patches were being extracted at the wrong dimension.
We'll face a lot of these unexpected data errors as time goes on. Currently, data is appended list-wise after its processed via augmentation. If an error happens in one data group (e.g. input modalities), but not the other (e.g. ground-truth) the two lists of data will become de-synced, leading to disaster. We need a way to A) catch errors in one data group, and then B) remove all corresponding data from the other data group.
I recently ran into a situation where one modality in one data group in one case out of a hundred cases had an extra dimension. Particularly, a FLAIR sequence had two time-points. This caused an error in patch extraction, as patches were being extracted at the wrong dimension.
We'll face a lot of these unexpected data errors as time goes on. Currently, data is appended list-wise after its processed via augmentation. If an error happens in one data group (e.g. input modalities), but not the other (e.g. ground-truth) the two lists of data will become de-synced, leading to disaster. We need a way to A) catch errors in one data group, and then B) remove all corresponding data from the other data group.