search

open-mmlab / mmdetection

OpenMMLab Detection Toolbox and Benchmark
https://mmdetection.readthedocs.io
Apache License 2.0
29.7k stars 9.48k forks source link

how to train referring expressions detection by this repo's implementation groundingDino? #11101

Open northeastsquare opened 1 year ago

northeastsquare commented 1 year ago

for example, I want to detect back cat, How to train from scrach or finetune? in https://github.com/open-mmlab/mmdetection/blob/main/configs/grounding_dino/README.md, can only train scratch or finetune close set object detection. Or how to add RefCOCO/+/g to train?

hhaAndroid commented 1 year ago

@northeastsquare You can directly refer to the documentation provided for fine-tuning. After fine-tuning, it becomes a nearly closed-set algorithm. Currently, "grounding dino" does not support training on "grefcoco". If deemed necessary, we will provide support for it in the near future.

northeastsquare commented 1 year ago

@hhaAndroid "grefcoco" training is very important, very necesssary. Could you give me some advise to implement it?