search

mmaaz60 / mvits_for_class_agnostic_od

[ECCV'22] Official repository of paper titled "Class-agnostic Object Detection with Multi-modal Transformer".
MIT License
299 stars 24 forks source link

Could you provide the checkpoint used to generate class-agnostic proposals in Object Centric OVD? #32

Open fushh opened 7 months ago

fushh commented 7 months ago

In Object Centric OVD, the authors use the checkpoint trained from a subset of LMDet which has no overlap with any of the evaluation datasets. However, it seems that the checkpoint MDef_DETR_r101_epoch20.pth mentioned in Issue#22 is trained with the full dataset as it is the same checkpoint in evaluation. Thus the checkpoint used to generate class-agnostic proposals is needed to prevent leaking information. Please let me know if I missed anything. Thank you.

fushh commented 7 months ago

is the checkpoint named MDef_DETR_r101_epoch20_ore.pth? This checkpoint is trained on a filtered dataset generated by removing all captions from LMDet listing any of the 60 unknown categories evaluated in ORE. I'm curious if this will stiil include the rare classes in the LVIS dataset.