black0017 / MedicalZooPytorch

A pytorch-based deep learning framework for multi-modal 2D/3D medical image segmentation
MIT License
1.72k stars 299 forks source link

Low validation DSC when training on Brats2018 #28

Open MohammedAdelFahmi opened 1 year ago

MohammedAdelFahmi commented 1 year ago

Hello, First of all, thanks for the amazing work. Question: I tried to train the Unet3D model on bratS 2018 dataset using the 'train_brats_2018_new.py'. but I got lower validation DSC and higher validation loss, I think the model is facing some trouble on validation set: image

MohammedAdelFahmi commented 1 year ago

@black0017

yeshunlong commented 1 year ago

Same problem, how to fix it? In other words, what is the best args for every model and dataset?

Gold3nk commented 1 year ago

I have also encountered the same issue. When training on the brats2018 and brats2019 datasets, the dice scores of the validation set consistently converge to slightly above 60, which is significantly lower than the dice scores of the training set. It seems that the inference code is incomplete as well. After attempting to fix it, I found that my dice score for the inference results is around 89, which seems incorrect because there shouldn't be such a large gap between the dice scores of my test set and training set, both of which come from the official training sets of brats2018 and brats2019. Due to my limited coding abilities, I had to abandon this code repository.

WindymanJOX commented 4 months ago

I think there is no proper DSC function for BratTS dataset in this repository. BratTS aims to seg WT, TC and ET, there are overlapping regions among those 3 areas, that is saying we should calculate the aboved 3 DSCs to show the performance of our trained model. But in this repo, they just put a general DSC func to all seg tasks.