search

ivadomed / model_sc_centerline

Repository for automated spinal cord centerline detection using deep learning
MIT License
2 stars 0 forks source link

Add more contrasts for training a multi-contrast model #3

Open naga-karthik opened 1 year ago

naga-karthik commented 1 year ago

Our experiment based on the preliminary hypothesis used on a single contrast (T2w) from the CanProCo dataset. It is important to gather the remaining contrasts for each subject and train a multi-channel/multi-contrast model (each additional contrast being added as an additional channel). This will be useful for robustness and also contrast-agnostic centerline detection.

@valosekj Would you please be able to preprocess the remaining contrasts as we did for T2w?

valosekj commented 1 year ago

@valosekj Would you please be able to preprocess the remaining contrasts as we did for T2w?

For remaining contrasts, we do not have ground truth spinal cord segmentation. Thus, we cannot easily obtain the centerline for these contrasts.

But I can co-register all contrasts to T2w. Then, we would be able to use the T2w centerline also for other contrasts.

jcohenadad commented 1 year ago

 For remaining contrasts, we do not have ground truth spinal cord segmentation. Thus, we cannot easily obtain the centerline for these contrasts. But I can co-register all contrasts to T2w. Then, we would be able to use the T2w centerline also for other contrasts.

It would be much easier to instead leverage our many other datasets on which we already have the spinal cord segmentations (spine-generic, etc.)

naga-karthik commented 1 year ago

But I can co-register all contrasts to T2w. Then, we would be able to use the T2w centerline also for other contrasts.

Just for my understanding, this should also work right? I understand that it will take time but it should be good if we want to use all contrasts from CanProCo?

jcohenadad commented 1 year ago

Just for my understanding, this should also work right? I understand that it will take time but it should be good if we want to use all contrasts from CanProCo?

yes, it should work, but registration needs to be QCed, which takes a bit of time

valosekj commented 1 year ago

Just for my understanding, this should also work right? I understand that it will take time but it should be good if we want to use all contrasts from CanProCo?

yes, it should work, but registration needs to be QCed, which takes a bit of time

I tried to co-register other contrasts to T2w based on nii headers using -identity 1:

https://github.com/ivadomed/model_sc_centerline/blob/cd6ffe1fba144bdb928b88dda68e48fac4ecc539/scripts/get_centerline_from_segmentation.sh#L150

To allow easy QC (we have >1000 coregistered images), I'm projecting the T2w centerline to the coregistered image using:

https://github.com/ivadomed/model_sc_centerline/blob/cd6ffe1fba144bdb928b88dda68e48fac4ecc539/scripts/get_centerline_from_segmentation.sh#L152-L155

Example (coregistered PSIR image and T2w_centerline): image

Based on the initial quick QC assessment, it seems that the registration works well for most subjects, and also, it seems that this type of QC is reasonable!