How to extract relation features

[moneyQyh]

I use the model offered by VinVL Feature extraction,.But after using the same setting as advised, I can only obtain bounding box features. So, how to extract relation features? Thanks

[Edwardmark]

@pzzhang any comments?

[hanxiaotian]

In order to extract relation features, you need to run inference using pretrained relation models. You also need to set this tp be true and add a keyword 'relation_feature' in tsv_save_subset. https://github.com/microsoft/scene_graph_benchmark/blob/a93180e85ce69baf67cd6300731baff8d10c1160/sgg_configs/oi_vrd/R152FPN_reldn_oi.yaml#L80 https://github.com/microsoft/scene_graph_benchmark/blob/a93180e85ce69baf67cd6300731baff8d10c1160/sgg_configs/oi_vrd/R152FPN_reldn_oi.yaml#L77

[moneyQyh]

Ok,I'll try it, thanks

[alice-cool]

In order to extract relation features, you need to run inference using pretrained relation models. You also need to set this tp be true and add a keyword 'relation_feature' in tsv_save_subset. https://github.com/microsoft/scene_graph_benchmark/blob/a93180e85ce69baf67cd6300731baff8d10c1160/sgg_configs/oi_vrd/R152FPN_reldn_oi.yaml#L80

https://github.com/microsoft/scene_graph_benchmark/blob/a93180e85ce69baf67cd6300731baff8d10c1160/sgg_configs/oi_vrd/R152FPN_reldn_oi.yaml#L77

Dear scholar , Do you know the file full_yaml_file: ../maskrcnn-benchmark-1/datasets1/flickr30k/tsv/flickr30k.yamlfull_yaml_file when running test_sg_net for producing visual features with bounding box and relation features?

[ckmstydy]

Ok,I'll try it, thanks

hi, have you successfully extracted the relation features?

[HiLittleFriend]

Ok,I'll try it, thanks

have you successfully extracted the relation features? after adding OUTPUT_RELATION_FEATURE and relation_feature, i still didn't get the relation feature