search

OpenDriveLab / OccNet

[ICCV 2023] OccNet: Scene as Occupancy
https://arxiv.org/abs/2306.02851
Apache License 2.0
554 stars 50 forks source link

How is the flow linked to each voxel #26

Open cbiras opened 8 months ago

cbiras commented 8 months ago

I am trying to train a network that predicts the dynamic voxels in a scene, so I need to link annotated flow to annotated voxels. Do you remember if it's possible to link the flow with each voxel? I wasn't able to figure out the relation between the two looking at the arrays and didn't find any information on this. Thank you!

tongwwt commented 8 months ago

The flow information is only linked to the foreground voxel. For the background voxel, the flow is zero, which is not stored in the array.

cbiras commented 8 months ago

@tongwwt I understand this, but how are foreground voxels linked to the flow data? Is there a 1-1 relationship? On simpler words, how do I know which entry in the flow array is linked to which voxel? The only way I see a possible 1-1 link is if the voxel at occ[0][0] has the flow information in flow[0]

tongwwt commented 8 months ago

Please refer to parse flow info, then you can see the relationship between the flow array and voxel.