xmed-lab / TriALS

MICCAI 2024: nnUNet incorporating additional baselines as SAMed️, Mamba Variants, and MedNeXT to establish a benchmark for segmentation challenges.
Apache License 2.0
51 stars 2 forks source link

streamline evaluation script #2

Closed FabianIsensee closed 1 month ago

FabianIsensee commented 3 months ago

The current evaluation code seems highly specific and tailored for your repository. It's all in one large script, which makes it difficult to apply it for unrelated algorithms. It could be useful for participants to wrap it into functions that they can call themselves, for example:

evaluate_folder(folder_with_gt_files, folder_with_pred_files) evaluate_case(pred_file, gt_file)

This should be quite doable in the existing script. The script can then just use these functions.

Best, Fabian

marwankefah commented 3 months ago

Hi Fabian,

I agree with you. I have only copied the LiTs evaluation script, but I will wrap it for better usability.

Thank you for bringing this to my attention,

Marawan Elbatel

marwankefah commented 1 month ago

Hi Fabian,

Apologies for the late response, I’ve refactored the evaluation code. Participants can now easily run the script on their folders, improving its usability.

Let me know if you have any further feedback.

Thank you, Marawan Elbatel

FabianIsensee commented 1 month ago

Thanks a lot!!