kunzmi / ImageStackAlignator

Implementation of Google's Handheld Multi-Frame Super-Resolution algorithm (from Pixel 3 and Pixel 4 camera)
GNU General Public License v3.0
399 stars 66 forks source link

How to create synthetic image bursts to run Google's Handheld Multi-Frame Super-Resolution algorithm? #26

Open 15210909974 opened 2 years ago

15210909974 commented 2 years ago

Hi! Thank you so much for your sharing of the implementation and correction of Google's Handheld Multi-Frame Super-Resolution algorithm. I struggled with this paper for a long time......

I was going to try this algorithm on my computer, but unfortunately, I don't have Google Pixel or SLR to get a burst of the RAW picture. And I found that the paper part 6.1 mentioned that they created synthetic image bursts by: generate a set of random offsets (Bivariate Gaussian distribution with a standard deviation of two pixels) resample the image using nearest-neighbor interpolation create a Bayer mosaic (discard 2/3 color channels)

But I failed to get the expected results... I just wonder whether you create these synthetic image bursts and if you'd like to post the code for creating synthetic image bursts on your Github? :)~

kunzmi commented 2 years ago

There is some functionality like this hidden in the code enabled via the _isTestMode variable, but I don't remember any details about it or how to use it... I'll leave that up to you to explore ;) I also posted the New York RAW images some time ago here: https://1drv.ms/u/s!Ar0iioVf9NOfhI5JEUXMXlyiznBAzg?e=xNQCGu

15210909974 commented 2 years ago

There is some functionality like this hidden in the code enabled via the _isTestMode variable, but I don't remember any details about it or how to use it... I'll leave that up to you to explore ;) I also posted the New York RAW images some time ago here: https://1drv.ms/u/s!Ar0iioVf9NOfhI5JEUXMXlyiznBAzg?e=xNQCGu

got it~ thx a lot! I'll try it ><