search

basilevh / occlusions-4d

Revealing Occlusions with 4D Neural Fields (CVPR 2022 Oral) - Official Implementation
https://occlusions.cs.columbia.edu/
MIT License
75 stars 5 forks source link

Any tutorial for training kitti odemetry dataset? #6

Closed rockywind closed 1 year ago

rockywind commented 1 year ago

Hi, Can I used this code to training Nuscene dataset or Kitti dataset for 3D reconstruction?

basilevh commented 1 year ago

Hello, In short, our method of supervision for training 3D reconstruction over time relies on switching to other camera perspectives of the same scene in order to perform dynamic scene completion, a bit like shape completion for object point clouds but then extended to entire scenes. Given one input video, the model must imagine what the scene looks like as seen from other viewpoints captured simultaneously, in order to learn about persistence of moving objects. Unfortunately, at least at the time of writing, there are no real world driving datasets with multiple viewpoints in this manner, which is why I used two synthetic datasets instead. Hope this helps!