vietanhdev / anylabeling

Effortless AI-assisted data labeling with AI support from YOLO, Segment Anything, MobileSAM!!
https://anylabeling.nrl.ai
GNU General Public License v3.0
2.04k stars 222 forks source link

Suggestion - Integrate MobileSAM into the pipeline for lightweight and faster inference #117

Closed mdimtiazh closed 1 year ago

mdimtiazh commented 1 year ago

Reference: https://github.com/ChaoningZhang/MobileSAM

Our project performs on par with the original SAM and keeps exactly the same pipeline as the original SAM except for a change on the image encode, therefore, it is easy to Integrate into any project.

MobileSAM is around 60 times smaller and around 50 times faster than original SAM, and it is around 7 times smaller and around 5 times faster than the concurrent FastSAM. The comparison of the whole pipeline is summarzed as follows:

image

image

Best Wishes,

Qiao

vietanhdev commented 1 year ago

Hi @mdimtiazh ! Thank you for your suggestion. However, it's best to have ONNX format models to avoid installing PyTorch, which is ~700MB to 1GB+ with this package. We may need to wait for the ONNX conversion from the MobileSAM's authors.

vietanhdev commented 1 year ago

@mdimtiazh Finished integration in v0.3.0.