About the `2018-04-27_bottom-up-attention_fixed_36` features - Githubissues

Cadene / murel.bootstrap.pytorch

MUREL (CVPR 2019), a multimodal relational reasoning module for VQA

https://arxiv.org/abs/1902.09487

BSD 3-Clause "New" or "Revised" License

194 stars 24 forks source link

About the `2018-04-27_bottom-up-attention_fixed_36` features #17

Open Zzmonica opened 5 years ago

Zzmonica commented 5 years ago

Hi! @Cadene @Hediby The .pth file includes many attributs of image, like: 'cls_scores', 'rois', 'pooled_feat', 'cls', 'norm_rois'

About the 'cls' key, how can you get the class of each roi ?
And I know the class number is corresbonding to the https://github.com/peteanderson80/bottom-up-attention/blob/master/data/genome/1600-400-20/objects_vocab.txt Obviously, this dictionary starts from 1 position. I noticed that you also have 0 class number that didn't appear in the dictionary, what's 0 class number stands for?

Hope for your respond!

Cadene commented 4 years ago

Unfortunately no :/
I think class 0 stands for background

Best luck!