Open Nilser3 opened 9 months ago
@Nilser3 as discussed and agreed on (https://github.com/neuropoly/data-management/issues/266#issuecomment-1743810312) the plan was to apply the contrast-agnostic model on these data, and then manually correct the output segmentations. Was there a misunderstanding somewhere?
Also, when sharing the QC, pls also add the current segmentation so we can compare with your corrections.
understood, I attach the QC here , where we can see:
@Nilser3 based on what I am seeing, you corrected "_label-SC_seg.nii.gz", not "_pred_bin.nii.gz". This is different than what is described in https://github.com/neuropoly/data-management/issues/268#issuecomment-1751146033.
okay,
To do the manual correction I used both masks (GT and pred_bin),
The main difference is the starting point of the SC (image attached)
So I'll go back to making corrections based on the "_pred_bin.nii.gz" alone.
To do the manual correction I used both masks (GT and pred_bin)
What do you mean by "I used both"? Did you mean visually, or algorithmically (eg: summation of both masks), or other? Please elaborate.
When flipping back-and-forth between the GT and _rater2, and then between pred_bin and _rater2, I notice that in most slices, the contour of the SC on _rater2 is more similar to GT than pred_bin. Given that the goal of the contrast-agnostic project is to avoid propagating the bias of the previous algo (deepseg_sc, which was applied to GT), we need to be very careful with choosing the starting point of the SC segmentation for manual correction. Tagging @sandrinebedard @naga-karthik @valosekj @plbenveniste who can further clarify if something is unclear in my explanation
What do you mean by "I used both"? Did you mean visually, or algorithmically (eg: summation of both masks), or other? Please elaborate.
Sorry, I was not clear, Indeed, I did a sum of the masks (GT and pred_bin), then a binarization of the result and finally I manually corrected this new mask
When flipping back-and-forth between the GT and _rater2, and then between pred_bin and _rater2, I notice that in most slices, the contour of the SC on _rater2 is more similar to GT than pred_bin
In general, the pred_bin masks seem eroded when compared to the GT, perhaps that is why the effect is seen that the corrections are more similar to the GT
In general, the pred_bin masks seem eroded when compared to the GT, perhaps that is why the effect is seen that the corrections are more similar to the GT
Exactly. And that is precisely the issue. By summing the two SC segmentations, you will keep the bigger one, which might not be the 'most accurate' one.
Thanks you! Now it makes more sense to me, So I will proceed to redo the segmentations but based only on the _predbin masks
Here is a manual correction, based only on the binarized images (pred_bin) of the contrast-agnostic masks (thr = 0.5001).
Here is a manual correction, based only on the binarized images (pred_bin) of the contrast-agnostic masks (thr = 0.5001).
You did a great job, Nilser! My only concern is that your manual correction seems to 'over-segment' compared to what the contrast-agnostic model produces. For example:
I would suggest to not alter too much the outer boundaries of the contrast-agnostic model (at the risk of introducing a bias when re-training the model with active learning), and primarily focus on:
Tagging @sandrinebedard @naga-karthik @valosekj @plbenveniste in case they have additional feedback
Also, feel free to upload the ZIP directly in this issue, in case the AMU link breaks in the future
Here is a QC of manual correction on the entire marseille-3T-mp2rage
dataset , based only on the binarized contrast-agnostic masks
Legend of QC maks
I suggest we put a hold on the correction of the masks until this issue is settled: https://github.com/sct-pipeline/contrast-agnostic-softseg-spinalcord/issues/99
Description
It has been observed that manual segmentations of SC in MP2RAGE datas (
basel-mp2rage
marseille-3T-mp2rage
) have some issues like:266
This issue is for improve these SC segmentations Here the first QC in some MP2RAGE subjects: https://amubox.univ-amu.fr/s/FBAfYqcGwGXRGRy
Related issues
266 #267