kaiko-ai / eva

Evaluation framework for oncology foundation models (FMs)
https://kaiko-ai.github.io/eva/
Apache License 2.0
59 stars 4 forks source link

Speed up segmentation metrics calculation #556

Closed ioangatop closed 2 months ago

ioangatop commented 3 months ago

Currently we utilise classification metrics for segmentation tasks; however, torchmetrics do provide segmentation metrics specialized for segmentation, like generalized_dice and mean_iou

We will have to investigate them in terms of scores and speed

ioangatop commented 2 months ago

some more metrics here: https://github.com/vqdang/hover_net/blob/67e2ce5e3f1a64a2ece77ad1c24233653a9e0901/metrics/stats_utils.py#L323