More improvements to occlusion estimation for point tracking

google-research / kubric

A data generation pipeline for creating semi-realistic synthetic multi-object videos with rich annotations such as instance segmentation masks, depth maps, and optical flow.

Apache License 2.0

2.35k stars 233 forks source link

More improvements to occlusion estimation for point tracking #285

Closed cdoersch closed 1 year ago

cdoersch commented 1 year ago

More improvements to occlusion estimation. Depth map interpolation used raster coordinates rather than pixel. We also detect occlusions by detecting when the point appears on the wrong segment in 2D, and when its surface normal faces away from the camera. This helps deal with very thin objects, where the depth map alone is unreliable. Should greatly improve the issues reported in https://github.com/google-research/kubric/issues/281 .

codecov-commenter commented 1 year ago

Codecov Report

Merging #285 (ff6a013) into main (6e4fe4c) will not change coverage. The diff coverage is n/a.

@@          Coverage Diff          @@
##            main    #285   +/-   ##
=====================================
  Coverage   66.0%   66.0%           
=====================================
  Files         43      43           
  Lines       3565    3565           
=====================================
  Hits        2353    2353           
  Misses      1212    1212

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more