search

sxyu / svox2

Plenoxels: Radiance Fields without Neural Networks
BSD 2-Clause "Simplified" License
2.79k stars 360 forks source link

Can this method be used to synthesize panoramas? #58

Open HHHendricks opened 2 years ago

HHHendricks commented 2 years ago

Hello, this method is great! ! ! I would like to know if this method can be used to composite a panorama？

sarafridov commented 2 years ago

As far as I understand it, the difference between a panorama and the 360 degree scenes that we evaluate on is that a panorama is typically background-only, and could probably be modeled more simply than a full Plenoxel grid (e.g. the foreground grid could be low resolution).

HHHendricks commented 2 years ago

I see. So can I generate a panorama directly with your code? If so how can I set the parameters?

Visuals3D commented 2 years ago

There is an option to render only the background of a scene so technically it might be possible. But the dataset you need to train a Plenoxel grid will be more then enought to create a panorama with much higher resolution and better quality in seconds using existing software like ptgui.

HHHendricks commented 2 years ago

When I train the TanksAndTempleBG dataset, I always run out of memory when the resolution is [640, 640, 640]. How can I adjust the parameters? The configuration I train on is a GTX Titan with 12212MB of video memory.

sarafridov commented 2 years ago

To reduce the memory requirements there are a few things to try. You can try reducing the final resolution, changing the optimizer (from RMSProp to SGD; SGD uses much less memory but also require more tuning of learning rate), and/or increasing the regularizers to encourage more sparsity.

HHHendricks commented 2 years ago

I tried it, but got really bad results, I was wondering what graphics card memory you guys are using