facebookresearch / segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
Apache License 2.0
46.57k stars 5.52k forks source link

Object Detection with Labels #391

Open Sandeep-GitHubAccount opened 1 year ago

Sandeep-GitHubAccount commented 1 year ago

Can we use SAM to detect objects or predict the objects encompassing mask and map it with object name?

jvpassarelli commented 1 year ago

I also wanted to predict the name with the bounding box from the mask. I used CLIP to associate a label with the box. Quick code and demo here

Sandeep-GitHubAccount commented 1 year ago

Thank you for your help. I will make sure to check out the link you provided.

I also wanted to predict the name with the bounding box from the mask. I used CLIP to associate a label with the box. Quick code and demo here

Thank you for your help. I will make sure to check out the link you provided.