search

valeoai / obow

Other
95 stars 17 forks source link

Can obow work in non-iconic image datasets like COCO? #1

Closed guanfuchen closed 3 years ago

guanfuchen commented 3 years ago

I see it uses bow, so can it conver the problem which contrastive-base methods work not perfect in non-iconic image datasets like COCO?

image

abursuc commented 3 years ago

Hi @guanfuchen!

Thanks for the interest in our work and sorry for the late reply -- we have a glitch with our account and didn't see notifications :(

Yes, OBoW can be extended to other non-object centric datasets. This is an benefit of feature reconstruction methods such as OBoW, BYOL, BoWNet, as they focus on reconstructing the features of the image itself and not on discriminating the (object centered) image from other images in the dataset, as done in contrastive methods.

There should not be major changes in the OBoW pipeline to extend it to other datasets. Depending on the content and size of the datasets, the size of the dictionary could benefit from some tuning.