This is a bug in the scene_obs section of the coordinates: object coordinates are mixed up in A and C which finally explains why we had these color mixup errors on confusion matrices ;)
To reproduce:
just visualize the data, or
track the std of object coordinates for the red/pink/blue annotated frame ranges, or
track the distance of tcp to said object for the red/pink/blue annotated frames
This is a bug in the scene_obs section of the coordinates: object coordinates are mixed up in A and C which finally explains why we had these color mixup errors on confusion matrices ;)
To reproduce: