Can I use this project for semantic segmentation? Cause I also cares about the segmentation and the category of the background. - Githubissues

IDEA-Research / Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

https://arxiv.org/abs/2401.14159

Apache License 2.0

14.11k stars 1.31k forks source link

Can I use this project for semantic segmentation? Cause I also cares about the segmentation and the category of the background. #462

Closed Luciennnnnnn closed 4 months ago

Luciennnnnnn commented 4 months ago

Hi, great work! Can I use this project for semantic segmentation? Cause I also cares about the segmentation and the category of the background.

Luciennnnnnn commented 4 months ago

I want to achieve semantic or panoptic segmentation, if Grounded-SAM can not do this, what's the recommended model?

rentainhe commented 4 months ago

@Luciennnnnnn Hello, G-SAM can do panoptic segmentation tasks, you can refer to this project as a good example:

https://github.com/segments-ai/panoptic-segment-anything

Luciennnnnnn commented 4 months ago

@rentainhe Hi, thank you for your recommendation, i'll take a look at it.

Luciennnnnnn commented 4 months ago

So if I want to achieve automatic open-vocabulary panoptic segmentation, is my current best choice RAM++ + G-SAM?

rentainhe commented 4 months ago

So if I want to achieve automatic open-vocabulary panoptic segmentation, is my current best choice RAM++ + G-SAM?

Yep, maybe this is the simplest way to achieve a good result, you can visualize and double-check the results

Luciennnnnnn commented 4 months ago

@rentainhe That would be great! Thanks!