Support proposal network sampling in nerf renderer

threestudio-project / threestudio

A unified framework for 3D content generation.

Apache License 2.0

6.32k stars 480 forks source link

Closed thuliu-yt16 closed 1 year ago

thuliu-yt16 commented 1 year ago

Support proposal network estimator in nerf renderer, based on nerfacc.
Add a new tested config prolificdreamer-propnet.yaml. It replaces the occupancy grid estimator with a proposal network estimator in the first stage.
Add update_step_end hook for Updatable, which is called before the end of each batch.
Add parse_scheduler_to_instance, which returns a lr_scheduler instance instead of a dict config and is used for proposal network optimization.

TODO

DSaurus commented 1 year ago

Hi, will you consider implementing this sampling method for neus? I'm currently working on that.