search

google-research / multinerf

A Code Release for Mip-NeRF 360, Ref-NeRF, and RawNeRF
Apache License 2.0
3.62k stars 341 forks source link

How to make a color video? #61

Open 3Bridge123 opened 1 year ago

3Bridge123 commented 1 year ago

Hi.

Thank you for your work. It's amazing!

I followed the README.md for training and rendering and got the following 4 videos.

checkpoints_my_dataset_dir_path_renders_step_0_acc.mp4 checkpoints_my_dataset_dir_path_renders_step_0_color.mp4 checkpoints_my_dataset_dir_path_renders_step_0_distance_mean.mp4 checkpoints_my_dataset_dir_path_renders_step_0_distance_median.mp4 image

But what I want is not a video like these heatmaps, but a color video like the demo.

How can I output a video like the demo?

jonbarron commented 1 year ago

The _color.mp4 video should be the RGB rendering. How do things look after you train for more than zero steps?

cezarbbb commented 1 year ago

@jonbarron Unfortunately I got the same issue:( The acc is totally white and the color is a mess.

jonbarron commented 1 year ago

Can you share the rendering? And its filename?

cezarbbb commented 1 year ago

Can you share the rendering? And its filename?

the rendering is just the same as the questioner provided. And my filename is checkpoints_earphone_over_book_path_renders_step_0_color.mp4.

cezarbbb commented 1 year ago

Can you share the rendering? And its filename?

And my dataset worked well in the original nerf:(

jonbarron commented 1 year ago

Since the filename has step_0_ in it, it seems like your training loop is doing zero steps of optimization, which will produce bad results. Sounds like there's something wrong with your training loop or how it's configured.