changwoonchoi / IBL-NeRF

Official implementation of IBL-NeRF: Image-Based Lighting Formulation of Neural Radiance Fields (Computer Graphics Forum, Pacific Graphics 2023)
https://changwoon.info/publications/IBL-NeRF
MIT License
41 stars 4 forks source link

Scene editing problems, such as roughness and albedo modification #5

Closed yunchao-ding closed 1 year ago

yunchao-ding commented 1 year ago

Hi, Dear author, sorry to bother you, I have some questions during the training process and would like to ask you for advice. I saw in your thesis that there is a function to edit the scene. That is, after IBL-NeRF decomposes the intrinsic components, a realistic new view image of the changed scene can be rendered by modifying the value of each component. How to modify to achieve the content shown in Figure 9 in the paper? Such as modifying roughness, albedo, etc. The output image is not changed in angle, but the values such as roughness and albedo in the image are changed, such as the results shown in Figure 9 and Figure 19. Thank you for your help!

changwoonchoi commented 1 year ago

Hi, To edit a scene or insert known 3D objects inside the scene, you can simply override the target_{}_maps inside the raw2outputs function of ibl_nerf_renderer.py into your new intrinsic components to replace at the specific viewpoint.

yunchao-ding commented 1 year ago

Thank you very much for your help!