IDEA-Research / Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
https://arxiv.org/abs/2401.14159
Apache License 2.0
15.09k stars 1.39k forks source link

Suggestion - Integrate MobileSAM into the pipeline for lightweight and faster inference #322

Closed qiaoyu1002 closed 1 year ago

qiaoyu1002 commented 1 year ago

Reference: https://github.com/ChaoningZhang/MobileSAM

Our project performs on par with the original SAM and keeps exactly the same pipeline as the original SAM except for a change on the image encode, therefore, it is easy to Integrate into any project.

MobileSAM is around 60 times smaller and around 50 times faster than original SAM, and it is around 7 times smaller and around 5 times faster than the concurrent FastSAM. The comparison of the whole pipeline is summarzed as follows:

image

image

rentainhe commented 1 year ago

Reference: https://github.com/ChaoningZhang/MobileSAM

Our project performs on par with the original SAM and keeps exactly the same pipeline as the original SAM except for a change on the image encode, therefore, it is easy to Integrate into any project.

MobileSAM is around 60 times smaller and around 50 times faster than original SAM, and it is around 7 times smaller and around 5 times faster than the concurrent FastSAM. The comparison of the whole pipeline is summarzed as follows:

image

image

Nice work! We will implement Grounded-MobileSAM into Grounded-Segment-Anything recently

rentainhe commented 1 year ago

We've already implemented it here: Grounded-MobileSAM and highlight it in our README @qiaoyu1002

qiaoyu1002 commented 1 year ago

Thanks a lot.

rentainhe commented 1 year ago

Thanks a lot.

You're welcome! We will try to build more demo on it

rentainhe commented 1 year ago

And I'm going to close this issue, any updates you can open a new issue to inform me or send me an email