neuropoly / data-management

Repo that deals with datalad aspects for internal use
4 stars 0 forks source link

Improving SC MP2RAGE manual segmentations #268

Open Nilser3 opened 9 months ago

Nilser3 commented 9 months ago

Description

It has been observed that manual segmentations of SC in MP2RAGE datas (basel-mp2rage marseille-3T-mp2rage) have some issues like:

image

This issue is for improve these SC segmentations Here the first QC in some MP2RAGE subjects: https://amubox.univ-amu.fr/s/FBAfYqcGwGXRGRy

Related issues

266 #267

jcohenadad commented 9 months ago

@Nilser3 as discussed and agreed on (https://github.com/neuropoly/data-management/issues/266#issuecomment-1743810312) the plan was to apply the contrast-agnostic model on these data, and then manually correct the output segmentations. Was there a misunderstanding somewhere?

Also, when sharing the QC, pls also add the current segmentation so we can compare with your corrections.

Nilser3 commented 9 months ago

understood, I attach the QC here , where we can see:

jcohenadad commented 9 months ago

@Nilser3 based on what I am seeing, you corrected "_label-SC_seg.nii.gz", not "_pred_bin.nii.gz". This is different than what is described in https://github.com/neuropoly/data-management/issues/268#issuecomment-1751146033.

Nilser3 commented 9 months ago

okay, To do the manual correction I used both masks (GT and pred_bin), The main difference is the starting point of the SC (image attached) image

So I'll go back to making corrections based on the "_pred_bin.nii.gz" alone.

jcohenadad commented 9 months ago

To do the manual correction I used both masks (GT and pred_bin)

What do you mean by "I used both"? Did you mean visually, or algorithmically (eg: summation of both masks), or other? Please elaborate.

When flipping back-and-forth between the GT and _rater2, and then between pred_bin and _rater2, I notice that in most slices, the contour of the SC on _rater2 is more similar to GT than pred_bin. Given that the goal of the contrast-agnostic project is to avoid propagating the bias of the previous algo (deepseg_sc, which was applied to GT), we need to be very careful with choosing the starting point of the SC segmentation for manual correction. Tagging @sandrinebedard @naga-karthik @valosekj @plbenveniste who can further clarify if something is unclear in my explanation

Nilser3 commented 9 months ago

What do you mean by "I used both"? Did you mean visually, or algorithmically (eg: summation of both masks), or other? Please elaborate.

Sorry, I was not clear, Indeed, I did a sum of the masks (GT and pred_bin), then a binarization of the result and finally I manually corrected this new mask

When flipping back-and-forth between the GT and _rater2, and then between pred_bin and _rater2, I notice that in most slices, the contour of the SC on _rater2 is more similar to GT than pred_bin

In general, the pred_bin masks seem eroded when compared to the GT, perhaps that is why the effect is seen that the corrections are more similar to the GT

jcohenadad commented 9 months ago

In general, the pred_bin masks seem eroded when compared to the GT, perhaps that is why the effect is seen that the corrections are more similar to the GT

Exactly. And that is precisely the issue. By summing the two SC segmentations, you will keep the bigger one, which might not be the 'most accurate' one.

Nilser3 commented 9 months ago

Thanks you! Now it makes more sense to me, So I will proceed to redo the segmentations but based only on the _predbin masks

Nilser3 commented 8 months ago

Here is a manual correction, based only on the binarized images (pred_bin) of the contrast-agnostic masks (thr = 0.5001).

jcohenadad commented 8 months ago

Here is a manual correction, based only on the binarized images (pred_bin) of the contrast-agnostic masks (thr = 0.5001).

You did a great job, Nilser! My only concern is that your manual correction seems to 'over-segment' compared to what the contrast-agnostic model produces. For example:

I would suggest to not alter too much the outer boundaries of the contrast-agnostic model (at the risk of introducing a bias when re-training the model with active learning), and primarily focus on:

Tagging @sandrinebedard @naga-karthik @valosekj @plbenveniste in case they have additional feedback

Also, feel free to upload the ZIP directly in this issue, in case the AMU link breaks in the future

jcohenadad commented 8 months ago

Proposed strategy: https://github.com/sct-pipeline/contrast-agnostic-softseg-spinalcord/issues/84

jcohenadad commented 6 months ago

Another more recent QC: https://github.com/sct-pipeline/contrast-agnostic-softseg-spinalcord/issues/84#issuecomment-1816557099

Nilser3 commented 5 months ago

Here is a QC of manual correction on the entire marseille-3T-mp2rage dataset , based only on the binarized contrast-agnostic masks

Legend of QC maks

jcohenadad commented 5 months ago

I suggest we put a hold on the correction of the masks until this issue is settled: https://github.com/sct-pipeline/contrast-agnostic-softseg-spinalcord/issues/99