yrcong / RelTR

RelTR: Relation Transformer for Scene Graph Generation: https://arxiv.org/abs/2201.11460v2
248 stars 49 forks source link

Evaluation #44

Open Gezelligheid-debug opened 8 months ago

Gezelligheid-debug commented 8 months ago

I don't understand why class Error, sub Error, obj Error, rel Is the error so high that I misunderstood or was the evaluation process wrong ![Uploading Averaged stats.png…]()

Gezelligheid-debug commented 8 months ago

Averaged stats

Gezelligheid-debug commented 8 months ago

Is the probability of 60, 75, 25, and 50 being misjudged? If the probability of misjudgment is 60%, it is too high.

yrcong commented 6 months ago

If my memory is correct, these error rates are the accuracy. There are many true negative that could be considered as positive (with low confidence scores) making the accuracy low.