MIC-DKFZ / nnUNet

Apache License 2.0
5.34k stars 1.63k forks source link

Longitudinal option / ideas for nnUNet? #2194

Open karllandheer opened 1 month ago

karllandheer commented 1 month ago

Hello, I have used nnUNet a lot, it's a great package. I have data which is longitudinal (i.e., the same subject at two different time points). This is a fairly common use case for imaging. The question I have, is there a way to segment both images simultaneously with nnUNet? In essence, condition the segmentation of time point 2 on time point 1? I have seen other groups do this for other packages (namely brain imaging), where they claim one is able to obtain more consistent segmentations this way. Do you have any ideas on how to do that with nnUNet (beyond obviously just sequentially running it on the two time points), or any plans to incorporate this? Thanks again for your help!

TaWald commented 4 weeks ago

Hey @karllandheer, currently nnU-Net does not support longitudinal images, but you @mrokuss and @ykirchhoff may be able to help you out in how to use longitudinal data

mrokuss commented 4 weeks ago

Hey @karllandheer

We've been working on a longitudinal version of nnUNet which will hopefully be released soonish in order to exploit exactly the benefits of time series data you were describing - will keep you posted :)

karllandheer commented 3 weeks ago

Wow! Great! Please keep me posted!