BBillot / SynthSR

A framework for joint super-resolution and image synthesis, without requiring real training data
Apache License 2.0
143 stars 23 forks source link

processing Hyperfine scans #3

Closed julien-dubois-k closed 2 years ago

julien-dubois-k commented 2 years ago

I have some images from Hyperfine, which I'd like to process to get "super resolution" scans. I actually have 3 T1-weighted and 3 T2-weighted scans, i.e. I do have high-resolution (well, 1.5mm) in each plane.

I tried your pretrained model on each pair of scans (it doesn't seem that you support using multiple images of a single modality).

The output is quite different for each pair of scans (and none of the outputs really matches the reference HR T1-MPRAGE that I have). So I'm coming to you for advice to move forward.

I know that your model requires the FSE sequence for T1 and T2. Here is what I have:

Are your models brain-specific? From the training images in the data folder I would assume so. I am interested in getting super resolution for the whole head, i.e. also scalp, skull and CSF. Would I need to retrain the models with my own whole head images?

Finally -- is there an easy way to combine several scans of the same modality?

BBillot commented 2 years ago

Hello,

the plain SynthSR doesn't handle multi-modality cases. For this reason, we trained another model only dedicated to Hyperfine scans, with stricter requirements:

This model is supposed to handle whole brain scans, so it should work in your case. And I don't understand what you mean by "is there an easy way to combine several scans of the same modality?". You can super-resolve several scans at the same time by putting them in the same folder and calling synthsr on this folder.

Hope this helps, Benjamin

julien-dubois-k commented 2 years ago

Hi Benjamin,

it is for the "standard" Hyperfine T1 and T2 acquisitions (FSE sequence) at 1.5x1.5x5mm axial resolution (so don't use it with coronal or sagittal scans).

thank you, I missed the axial constraint.

And I don't understand what you mean by "is there an easy way to combine several scans of the same modality?" You can super-resolve several scans at the same time by putting them in the same folder and calling synthsr on this folder.

What I saw is that if there are multiple images in a folder, they are resolved one by one (and in the case of two folders with T1 and T2, they are resolved pair by pair, in order). So say I had two axial T1s from Hyperfine, I'd need to average them myself first before running these models.

If I wanted to retrain the model on e.g. the coronal or sagittal scans, could I do that? Thank you!

BBillot commented 2 years ago

sorry for the (very) late answer.

So say I had two axial T1s from Hyperfine, I'd need to average them myself first before running these models. Correct.

If I wanted to retrain the model on e.g. the coronal or sagittal scans, could I do that? Yes, sure. You'll need a bunch of training segmentation maps (with labels for cerebral and extra-cerebral structures), and probably a segmentation network.