search

YaoZhang93 / mmFormer

[MICCAI 2022] The official code for "mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation"
Apache License 2.0
93 stars 10 forks source link

input for missing modality #13

Open ejawany95 opened 10 months ago

ejawany95 commented 10 months ago

Congratulations on your great work. However, I have a question why did you choose to apply delta for the missing modality in the middle of the network rather than at the input stage?

YaoZhang93 commented 10 months ago

Thanks for your interest. During training the network, if we apply the delta at the input stage, it might disturb the training of the single-modal encoder.