search

half-potato / nmf

Our method takes as input a collection of images (100 in our experiments) with known cameras, and outputs the volumetric density and normals, materials (BRDFs), and far-field illumination (environment map) of the scene.
https://half-potato.gitlab.io/posts/nmf/
MIT License
52 stars 3 forks source link

Regarding the relighting evaluation #17

Closed dehezhang2 closed 6 months ago

dehezhang2 commented 7 months ago

May I ask where you get the ground truth images for relighting metrics evaluation for shiny blender dataset? Could you please provide the relighting dataset, or provide the way to generate the relighting evaluation dataset?

gkouros commented 7 months ago

You can download the shiny blender models from the webpage of Ref-NeRF. Then you simply regenerate the datasets with different HDRI images to get the relighted ground truth. I think all the used HDRIs are already in blender by default.

dehezhang2 commented 7 months ago

You can download the shiny blender models from the webpage of Ref-NeRF. Then you simply regenerate the datasets with different HDRI images to get the relighted ground truth. I think all the used HDRIs are already in blender by default.

Thanks for your quick reply. And in terms of regeneration, did you use blender nerf or other scripts?

gkouros commented 7 months ago

One of those scripts yes, I don't remember which one exactly, but to generate the exact same poses I had to import the json file from the original shiny blender dataset, since I couldn't find an analytical method instead.

Perhaps @half-potato has a different more efficient way to do this?

dehezhang2 commented 7 months ago

One of those scripts yes, I don't remember which one exactly, but to generate the exact same poses I had to import the json file from the original shiny blender dataset, since I couldn't find an analytical method instead.

Perhaps @half-potato has a different more efficient way to do this?

Thanks. And also may I ask for more details about the relighting evaluation? Did you use only one more unseen environment map (the Christmas one) to do the evaluation?

gkouros commented 7 months ago

I haven't done any such evaluation for my project yet. Ask @half-potato.

half-potato commented 7 months ago

Yes. It is reasonably high frequency.

half-potato commented 7 months ago

I used the original blend files, replaced the background, and rerendered them. I’ll ask for permission to release the dataset.

half-potato commented 7 months ago

Hopefully this helps: https://drive.google.com/file/d/131eN_Kfo-_-TOPwWjCyc02KjyOTY7bxR/view?usp=sharing

dehezhang2 commented 6 months ago

Hopefully this helps: https://drive.google.com/file/d/131eN_Kfo-_-TOPwWjCyc02KjyOTY7bxR/view?usp=sharing

Thanks for sharing the dataset!

dehezhang2 commented 5 months ago

May I also ask how you evaluated the relighting for nvdiffrec and nvdiffrecmc? Did you use the blender script or change their environment map during testing?

half-potato commented 5 months ago

I used a blender script to rerender things with a new environment map.