search

cvlab-stonybrook / SelfMedMAE

Code for ISBI 2023 paper "Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentation"
Apache License 2.0
112 stars 12 forks source link

NaN Loss #9

Open slefcourt27 opened 8 months ago

slefcourt27 commented 8 months ago

Hi,

Thanks for releasing your code publicly. I have been encountering problems training this using the BTCV dataset as well as my own during training. I notice that the loss quickly becomes NaN before 100 epochs. Did you encounter this same issue? I am using the same library packages, pytorch and python versions. If you did encounter this during your experiments, will you please share your approach to handling it?

Any help is greatly appreciated! Screenshot 2024-04-07 at 12 19 18 AM

MarkonH commented 4 months ago

Hello,

I encountered the same issue while training on my dataset. Do you happen to know the cause or have you found a solution?

I would greatly appreciate any insights or advice you could share. Thank you very much in advance!