google-research / multinerf

A Code Release for Mip-NeRF 360, Ref-NeRF, and RawNeRF
Apache License 2.0
3.58k stars 339 forks source link

How to render the video with my own camera track? #33

Open geyanlu opened 1 year ago

geyanlu commented 1 year ago

Hi, thanks for your great work.I want to render the video with my own camera track like ngp,can you give me some advice?, thanks a lot!

bmild commented 1 year ago

There are a couple ways to go about this. The two easiest are:

  1. Construct a new smooth set of N camera pose matrices yourself and save it as a numpy array with shape [N, 3, 4] in a .npy file, then pass this to the render job using this flag.
    Config.render_path_file = 'my_render_poses.npy'
  2. Specify a list of image filenames (from the input image folder) to be used as spline keyframes to create a smooth camera trajectory, pass the path of a txt file with this list (one filename per line) using this flag:
    Config.render_spline_keyframes = 'keyframe_image_filenames.txt'
guijuzhejiang commented 1 year ago

Is there a script or visual tool to generate the render_path_file?

MaxChanger commented 1 year ago

@bmild Hi, I also need to generate a new camera trajectory for rendering. But I have tried several methods, the rendered images (from imported render_path_file.npy) are filled with noise. Could you provided some scripts to generates this?

ZepSbosnia commented 1 year ago

I'm facing the same issue.. How can identify the camera position by the poses matrix and how can I from the camera poses and angles construct the poses matrix