mazurowski-lab / finetune-SAM

This is an official repo for fine-tuning SAM to customized medical images.
https://arxiv.org/abs/2404.09957
Apache License 2.0
114 stars 17 forks source link

multiple object in a same image #13

Closed JaberAlNahian closed 2 months ago

JaberAlNahian commented 3 months ago

Thank you for your great work! I would like to know how this pipeline can segment multiple objects in a single image.

Guhanxue commented 3 months ago

do you mean multi-cls segmentation?

JaberAlNahian commented 3 months ago

Not really. I mean single class but multiple objects in an image. I am trying to segment wheat heads from an image. As there are multiple wheat heads in an image, I need to segment all the wheat heads.

haoyudong-97 commented 2 months ago

I don't think you can segment multiple objects in an image w/ SAM. This is a problem rooted in SAM. In another paper (https://www.sciencedirect.com/science/article/pii/S1361841523001780) we test SAM on medical images and find that if we have prompts for one lung, it usually does not segment both lungs simultaneously.