search

yrcong / RelTR

RelTR: Relation Transformer for Scene Graph Generation: https://arxiv.org/abs/2201.11460v2
229 stars 45 forks source link

demo #57

Open Gezelligheid-debug opened 1 month ago

Gezelligheid-debug commented 1 month ago

May I ask how this type of image with orange and blue markings was generated 123

yrcong commented 1 month ago

I cannot find the source code now. ANYHOW, you can refer to the Colab demo code. Just represent the attention map as a heatmap and overlay it with the image, it is not hard.

Gezelligheid-debug commented 1 month ago

Thank you very much. I want to do abnormal behavior recognition for the subway, so I took a photo of me touching a shield door. After the demo, only the result was "people wearing clothes", but there was no "person touching the door" relationship between people and objects. May I ask why?

yrcong commented 1 month ago

This can be happened, since in Visual Genome (training set) there are not many these samples. You can finetune the model with your own data if you want to specify the task.