search

IDEA-Research / Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
https://arxiv.org/abs/2401.14159
Apache License 2.0
14.11k stars 1.31k forks source link

Grounded SAM is now available in 🤗 Transformers, with an easy tutorial #486

Open NielsRogge opened 2 months ago

NielsRogge commented 2 months ago

Hi folks!

Since Grounding DINO and SAM are now both available in the Transformers library, one can perform Grounded Segment Anything in just a few lines of code.

Refer to the demo notebook: https://github.com/NielsRogge/Transformers-Tutorials/blob/master/Grounding%20DINO/GroundingDINO_with_Segment_Anything.ipynb.

Full credits go to @eduardopach

rentainhe commented 2 months ago

Thank you so much for implementing Grounded-SAM in Transformers library!

TikaToka commented 2 months ago

Thank you! But is it required to always put prompt (label) ?

EduardoPach commented 2 months ago

Thank you! But is it required to always put prompt (label) ?

In the aforementioned tutorial, yes you need. As we don't have a previous tagging stage.