Jamy-L / Handheld-Multi-Frame-Super-Resolution

Handheld Multi-image Super-resolution [Wronski et al., SIGGRAPH19]. Non-official GPU-supported Python implementation.
MIT License
117 stars 20 forks source link

Support for different CFA patterns #26

Closed tvercaut closed 1 year ago

tvercaut commented 1 year ago

Thanks for the nice work. It looks like the assumption of a standard 2x2 Bayer filter is assumed. Are there any plans to relax that assumption to work with other configurations such as Quad-CFA?

Some mobile phones (e.g. Xiaomi Mi 10 Ultra) are now equipped with such sensors.

Single samples (no burst) can be found here: https://github.com/darktable-org/rawspeed/issues/256 https://drive.google.com/drive/folders/1EPZEpvBHupHehsYI600f9cS7m_MaVhSQ?usp=sharing

Jamy-L commented 1 year ago

Hi and thank you for your interest in the project. Adding other array configurations is not planned because I think it would make the code less readable and would diverge too much from the paper.

However it is totally do-able and I encourage you to propose a fork if you feel like it may be useful. The key to make it work are :

In the end, it all boils down to figuring out how to decimate a raw image to grey or to rgb with the new pattern. The easiest may be nearest neighbour intepolation for each color channel separately, then averaging to grey.

tvercaut commented 1 year ago

Many thanks for the fast response. As there are no current plans for it, I'll close this issue but would re-open it if/when we have any progress to share on our side.