neheller / kits21

The official repository of the 2021 Kidney and Kidney Tumor Segmentation Challenge
MIT License
174 stars 47 forks source link

no-contrast CTs get bad performance on KiTS model #61

Open nohalloween opened 1 year ago

nohalloween commented 1 year ago

hi!recently i have been working on no-contrast CTs(more than 300) kidney segmentation,while 90% of them get very bad performance on KiTS. it confused me and I have checked the two datasets ,both KiTS and mine ,to ensure they remain highly consistent expect for differences in kidney HU intensity. I do have some other CTs with contrast (just like the KiTS) and the fact is that when do the inference on kidney filled with medium, KiTS model demonstrats outstanding performance but it fails to segment a whole kidney in no-contrast CTs. is there any chance that KiTS21/19 model rely on high HU intensity too much to make judgments using contrast,while hardly capturing other features such as position and shape so that when medium disappears the model cannot recognize kidneys?

neheller commented 1 year ago

It's always difficult to say what features, exactly, the segmentation model is using the make its predictions, but your results seem to suggest that enhancement is an important feature. This doesn't surprise me too much since the kidneys enhance so conspicuously, especially in the arterial contrast phase.

Of course, in the context of the KiTS21 training set, non-contrast CT scans are "out of distribution" and so it's difficult to reason about expected performance on that population. But one thing that might help is to train on other contrast phases as well, if not non-contrast. The KiTS23 dataset includes cases in the nephrogenic phase, which might force the model to learn through some of the aterial-dependent features its using.