yeerwen / UniSeg

MICCAI 2023 Paper (Early Acceptance)
Other
174 stars 5 forks source link

Test dataset to evaluate upstream models #4

Closed YYinn closed 1 year ago

YYinn commented 1 year ago

Thank you for your excellent work. I finished the training phase of upstream task and was trying to evaluate those models. But I noticed that all the pkl files created by Convert_XX_to_nnUNet_dataset contain empty 'test' dictionary. According to the Tab. 1 in paper, how can i find the test dataset of those upstream tasks? Thank you!

yeerwen commented 1 year ago

Actually, for each dataset, we use its validation data as the test data to evaluate the model's performance. To avoid test data (validation data) leaking, we use the checkpoint from the last iteration as the final checkpoint and do not use any post-processing in nnUNet.

YYinn commented 1 year ago

Thank you!