biigle / magic-sam

:m: BIIGLE module for the Magic SAM image annotation instrument
GNU General Public License v3.0
0 stars 0 forks source link

HQ-SAM #25

Open dlangenk opened 3 weeks ago

dlangenk commented 3 weeks ago

There is a finetuned variant of SAM available at https://github.com/SysCV/sam-hq which promises better segmentation masks at basically no cost.

To upgrade to sam-hq, we basically only have to replace the sam package that is installed with pip with sam-hq (also pip compatible) and download the new weights. The front end is completely compatible with the new embeddings (already tested).

Although there is no very big perceived improvement, it might be worth it.

mzur commented 3 weeks ago

The low resolution of the feature representation is probably still the most limiting factor. If you don't see a big improvement in the cases you tested in #9, I don't see an immediate need to implement this :thinking:

dlangenk commented 3 weeks ago

Yes it is. But if we solved that it might be worth to implement it. Creating the pull request will only take 10-40 min.

mzur commented 3 weeks ago

Right. But then I want an example that HQ SAM provides better results than the current implementation :wink: