isi-vista / adam

Abduction to Demonstrate an Articulate Machine
MIT License
11 stars 3 forks source link

Calculate GNN's situation-level test accuracy #1212

Closed spigo900 closed 1 year ago

spigo900 commented 1 year ago

To make it easier to relate ADAM accuracy to GNN accuracy it would be nice to calculate the GNN's situation-level test accuracy as opposed to only calculating the object-level test accuracy. It would be good to have those numbers for the report, especially to explain the one weird color segmentation result where ADAM test accuracy is higher than the GNN's object-level test accuracy (but lower than the GNN's situation-level test accuracy).