continue-revolution / sd-webui-segment-anything

Segment Anything for Stable Diffusion WebUI
3.37k stars 204 forks source link

[Feature]: Integrate MobileSAM into the pipeline for lightweight and faster inference #139

Closed qiaoyu1002 closed 1 year ago

qiaoyu1002 commented 1 year ago

Expected behavior

Reference: https://github.com/ChaoningZhang/MobileSAM

Our project performs on par with the original SAM and keeps exactly the same pipeline as the original SAM except for a change on the image encode, therefore, it is easy to Integrate into any project.

MobileSAM is around 60 times smaller and around 50 times faster than original SAM, and it is around 7 times smaller and around 5 times faster than the concurrent FastSAM. The comparison of the whole pipeline is summarzed as follows:

image

image

continue-revolution commented 1 year ago

Thank you for your contribution and I'm glad to support.

Edit: supported