google / dynibar

Implementation of DynIBaR Neural Dynamic Image-Based Rendering (CVPR 2023)
https://dynibar.github.io/
Apache License 2.0
852 stars 40 forks source link

How to make slow motion or stereo video ? #10

Open mediarl opened 1 year ago

mediarl commented 1 year ago

Very impressive demo.

I am not sure to understand how it works. Is the code actually released can be used to make slow motion or stereo video as seen in the demo ?

zhengqili commented 1 year ago

Hi,

We were using internal tools to create final stereo anaglyph from a stereo pair rendered from the model. In terms of slow-motion, you need to integrate 3D scene flow splatting technique from NSFF (https://github.com/zhengqili/Neural-Scene-Flow-Fields/blob/main/nsff_exp/render_utils.py#L84) in order to perform time interpolation.

atonalfreerider commented 1 year ago

Is it also possible to feed more than one video of the same subject to the program? I.e. two or more camera angles filmed at the same time of the same subject?