taozh2017 / HiNet

Code for TMI 2020 "Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis"
86 stars 20 forks source link

Overflow problem #18

Open DISAPPEARED13 opened 2 years ago

DISAPPEARED13 commented 2 years ago

Hi there, thanks for your work, it's really inspiring! I notice that in synthesis network, you use multiple MFB to mix feature maps, and in the MFB, there is a multiple computation. With so many feature map in this computation, how can you provide from the NaN problem when training? Because mul especially in 3D Volumn, might cause overflow problem and I use MFB in mixed precision mode.

Thanks a lot!