search

yuehaowang / bilarf

Code Release for "Bilateral Guided Radiance Field Processing"
https://bilarfpro.github.io/
Apache License 2.0
133 stars 7 forks source link

about decouple ISP enhancement #4

Closed LuXiao0228 closed 3 months ago

LuXiao0228 commented 3 months ago

Hello,

I have a small query regarding your outstanding article and would greatly appreciate your guidance.

In the paper, you mention the use of a bilateral grid to "decouple ISP enhancement" while simultaneously reconstructing the radiance field without the camera's ISP enhancement, wouldn't this approach result in an image that resembles the greenish raw output from the camera sensor? However, it appears that the paper does not reconstruct the radiance field without ISP enhancement, as the test results directly compare the rendered views with the corresponding ground truth sRGB. I would like to know if the description of "decoupling ISP enhancement" in the paper is reasonable? Or is the primary function of the bilateral grid proposed in the paper to learn the enhancement for the inconsistencies across multiple views?

Thank you for your time and assistance.

yuehaowang commented 3 months ago

Hi,

Thank you very much for your question! Yes, "decouple ISP enhancement" refers to disentangling inconsistent ISP enhancement across input views.

Given multi-view images only, inversion of the whole ISP pipeline is unlikely feasible. Our workaround is to inverse part of the ISP. In this way, radiance fields will output renderings with average processing, and per-view bilateral grids will express the specific processing for each view.

LuXiao0228 commented 3 months ago

Your response has resolved my confusion. Thank you very much for your detailed explanation!