search

MASILab / 3DUX-Net

240 stars 33 forks source link

Problem reproducing results #27

Closed mostafij-rahman closed 1 year ago

mostafij-rahman commented 1 year ago

Hi, thank you for your great work.

We are having difficulty reproducing results on FETA 2021 and FLARE 2021 datasets. The reported average Dice score of FETA 2021 is 0.874 but we got an average Dice score of 0.813 (fold 1: 0.8871, fold 2: 0.7836, fold 3: 0.8558, fold 4: 0.7765, fold 5: 0.7642) using the default experimental setup of this GitHub repo. In FLARE 2021, we got an average Dice score of 0.926 (fold 1: 0.9372, fold 2: 0.9366, fold 3: 0.9148, fold 4: 0.9184, fold 5: 0.9239) but the reported Dice score is 0.934.

Could you please share the folding you have? Or what should we do to reproduce the results?

Thanks, Mostafij

leeh43 commented 1 year ago

Thank you for your interest towards our work! Do you mind to give me your email address? I believe I can send you the FLARE data split first (As I organize it better first).

mostafij-rahman commented 1 year ago

Thanks for the prompt response. You can send them to mostafijur.rahman@utexas.edu. I am requesting you to share the FETA 2021 splits also as I significantly lower Dice score in this dataset.

Thank you, Mostafij

zhangmk5 commented 1 year ago

Thank you for your interest towards our work! Do you mind to give me your email address? I believe I can send you the FLARE data split first (As I organize it better first).

Hi @leeh43 can you please send me the FLARE data split too? My email is huiyuan440@gmail.com。Thanks!

CamillerFerros commented 1 year ago

Thank you for your interest towards our work! Do you mind to give me your email address? I believe I can send you the FLARE data split first (As I organize it better first).

Hi @leeh43 can you please send me the FLARE data split too? My email is 1226656132xb@gmail.com。Thanks!

xzhang123456 commented 1 year ago

Hi @leeh43 can you please send me the FLARE data split too? My email is zzw1322412@outlook. com Thanks!

cyuan031 commented 1 year ago

Hi @leeh43 can you please send me the FLARE data split too? My email is c1511442795@gmail.com Thanks!

leeh43 commented 1 year ago

Hi @cyuan031, I have already pushed the flare dataset split as dataset_FLARE.json to the GitHub.

mostafij-rahman commented 1 year ago

Thanks for updating the repo with AMOS and FLARE splits. Could you please upload the FETA splits?

Thanks, Mostafij

leeh43 commented 1 year ago

@mostafij-rahman Yes! Will do it afterwards.