open-mmlab / mmdetection

OpenMMLab Detection Toolbox and Benchmark
https://mmdetection.readthedocs.io
Apache License 2.0
28.5k stars 9.28k forks source link

Fine tune Grounding DINO as open set with custom coco #11724

Open narchitect opened 1 month ago

narchitect commented 1 month ago

Hi, Thank you for sharing this amazing open source. I've tried to fine tune grounding DINO as open set because fine-tuned grounding DINO as closed set is not compatible with grounded SAM repo. I guess when fine-tuning it only with coco format, it turns to closed set algorithm and the architecture is different from the original model.

is there a way to fine-tune grounding dino as open set with my custom coco? then which configuration file do I need to use once I successfully converted my custom coco to ODVG?

zhangxgu commented 1 month ago

Mark