google-research / kubric

A data generation pipeline for creating semi-realistic synthetic multi-object videos with rich annotations such as instance segmentation masks, depth maps, and optical flow.
Apache License 2.0
2.34k stars 233 forks source link

MOVi-A optical flow of background #293

Open krishk97 opened 1 year ago

krishk97 commented 1 year ago

Hi,

I am having trouble understanding how the forward and backward flows for MOVi-A scenes are rendered. Specifically, I would like to know why flows corresponding to shadows are not generated (see attached gifs). Are the forward and backward flows motion fields and not optical flows?

kubric_movi_a_example kubric_movi_a_example_foward_flow kubric_movi_a_example_foward_flow_quiver