kaiko-ai / eva

Evaluation framework for oncology foundation models (FMs)
https://kaiko-ai.github.io/eva/
Apache License 2.0
66 stars 4 forks source link

Add support for including original image to segmentation decoder forward pass #698

Closed nkaenzig closed 1 month ago

nkaenzig commented 1 month ago

We've found in experiments that including passing the original image to the decoder can boost performance significantly, as fine-grained information about the object outlines might be lost in the embedding space rendered by vision FMs.