How to train Grounded-segment-anything or how to replace some parts with other similar models?

IDEA-Research / Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

https://arxiv.org/abs/2401.14159

Apache License 2.0

14.88k stars 1.38k forks source link

How to train Grounded-segment-anything or how to replace some parts with other similar models? #432

Open zsy7532 opened 8 months ago

zsy7532 commented 8 months ago

Hi, you have mentioned that all parts can be used separately or can be replaced with any similar but different models in readme.md. Could you tell me how to replace some parts with other similar models? I would appreciate it if you released the train code!

rentainhe commented 8 months ago

Hello, grounded-sam is a vision-pipeline by combining open-set detector with promptable segmentor, you can replace any parts of this pipeline like replacing sam with mobile-sam for faster segmentation or replace Grounding-DINO with GLIP