hanatos / vkdt

raw photography workflow that sucks less
https://jo.dreggn.org/vkdt
BSD 2-Clause "Simplified" License
376 stars 34 forks source link

Feature: combined demosaicing and denoising #71

Open tpapp opened 1 year ago

tpapp commented 1 year ago

Combining demosaicing and denoising is intuitively appealing, as it treats the information captured by the sensor as a noisy sample of an underlying image.

Some examples include:

I don't know enough about Vulkan to judge which of these would be feasible, but it seems that combining these two steps into a single one would result in improved reconstruction.

hanatos commented 1 year ago

yeah i think i know these papers and/or similar ones. it's a rathole though. i'm going to say that probably all of that is possible in vk, but i'm not sure i want to jump into it.

i haven't had much success outputting interpolated pixels from the pre-demosaic denoiser for instance. mostly there are edge cases that make custom cut code sharper for demosaicing and avoid colour artifacts better.

so i guess i'm saying: yes, probably there's something to be gained but i'll not go around actively researching literature for something here. if you have one specific paper with super convincing results and reasonably simple algorithm we can discuss though.