microsoft / scene_graph_benchmark

image scene graph generation benchmark
MIT License
382 stars 86 forks source link

How to generate the predicted object attributes and relations labels together? #50

Open yangapku opened 2 years ago

yangapku commented 2 years ago

@hanxiaotian Hi, thanks a lot for releasing the great SGG benchmark! I want to extract the predicted scene graph (with predicted boxes, attributes and relations) from scratch for new images using the pre-trained models in the model zoo. However, when I try to use the demo script, I notice the model cannot predict attributes and relations together (the VinVL pre-trained model only predicts the attributes and the RelDN pre-trained model only generates relations, where I need to do further ad-hoc alignment with the two outputs to predict a full scene graph). Is there any way to achieve this using a single provided pre-trained model? (Sorry I'm not very familiar with this task.) Thank you very much!