search

sandipan211 / ZSD-SC-Resolver

Resolving semantic confusions for improved zero-shot detection (BMVC 2022)
MIT License
22 stars 4 forks source link

I have some questions about training on VOC datasets #23

Open lichong0 opened 3 months ago

lichong0 commented 3 months ago

During the training and testing processes of a generative model（The fifth step and the sixth step）. Do both the val and test sets in the VOC dataset configs file need to be set to 'seen' or unseen ? val=dict( type=dataset_type, ann_file=data_root + 'VOC2007/ImageSets/Main/val.txt', img_prefix=data_root + 'VOC2007/', classes_to_load='seen', split=split, pipeline=test_pipeline), test=dict( type=dataset_type, ann_file=data_root + 'VOC2007/ImageSets/Main/test.txt', img_prefix=data_root + 'VOC2007/', split=split, classes_to_load='seen', pipeline=test_pipeline))

sandipan211 commented 3 months ago

In case of VOC, follow this config file. Both should be seen. It has been a while since I uploaded the codes, and I don't exactly remember why we kept them like this. Maybe we have hardcoded something in some intermediate file. But it is correct.

lichong0 commented 3 months ago

When to set unsee categories，test？

lichong0 commented 3 months ago

In case of VOC, follow this config file. Both should be seen. It has been a while since I uploaded the codes, and I don't exactly remember why we kept them like this. Maybe we have hardcoded something in some intermediate file. But it is correct.

Are the settings the same for ZSD and GZSD?

sandipan211 commented 3 months ago

When to set unsee categories，test？

In case of VOC especially, just keep it exactly the same as mentioned in this file.

sandipan211 commented 3 months ago

In case of VOC, follow this config file. Both should be seen. It has been a while since I uploaded the codes, and I don't exactly remember why we kept them like this. Maybe we have hardcoded something in some intermediate file. But it is correct.

Are the settings the same for ZSD and GZSD?

For VOC dataset, ZSD/GZSD setting was ill-defined when we did this work. If you look at our paper, for VOC, we have just shown seen and unseen class results - nothing explicitly defined as ZSD/GZSD as in MSCOCO.

To summarize, for VOC we just did one experiment following previous works - just find the results separately on seen and unseen classes and report them. And that experiment shall be done following our command in step 6, replacing with voc related weight files and config files.

Please use the "zsd" flag for evaluation on VOC.