search

ImpulseAdventure / JPEGsnoop

JPEGsnoop: JPEG decoder and detailed analysis
http://www.impulseadventure.com/photo/jpeg-snoop.html
GNU General Public License v2.0
539 stars 90 forks source link

ToF (time of flight) sensor data extraction #47

Open msch72 opened 4 years ago

msch72 commented 4 years ago

Hi, JPEGsnoop is a great tool and project. The reason for this new "issue" is rather an idea for a potential new feature.

I am planning on getting one of those new phones that have a ToF sensor. This might be used for background-blur (bokeh) effects; some phones even allow to ally this after the photo has been taken. I believe that this requires the depth information to be stored along with the image. This might be interesting to extract, for example to use for 3D modeling purpose... and I would just find it interesting.

Unfortunately, I don't have such a phone, yet (my old one still works), so that I don't have any example pictures. A device that has the post processing-bokeh is for example the Huawei P30 pro.

Best regards, Martin.

ImpulseAdventure commented 4 years ago

Hi Martin -- thanks for the feature suggestion!

Recent phones (eg. iPhones with iOS 11) can save images in the HEIC format which can include the depth map channel. It would definitely be interesting to incorporate decoding functionality for this format. I have not yet looked at the specification to see how similar the decoding may be (I understand that it still relies on DCT but variable-sized blocks).