search

apple / ARKitScenes

This repo accompanies the research paper, ARKitScenes - A Diverse Real-World Dataset for 3D Indoor Scene Understanding Using Mobile RGB-D Data and contains the data, scripts to visualize and process assets, and training code described in our paper.
Other
662 stars 58 forks source link

Depth Map Downsampling #31

Closed jjparkcv closed 2 years ago

jjparkcv commented 2 years ago

Hi, thank for sharing such a great dataset!

I was looking at the depth map upsampling task introduced by this dataset. However, I'm thinking that the current resolution of the ground depth map (1920x1440) is a bit too high for my use case. So I was wondering if you have already implemented some downsampling script for a depth map, because it is not as straightforward as downsampling RGB images.

Thank you!

gbaruch commented 2 years ago

Hu, First, we are happy you find the dataset useful!

Unfortunately, we are not planning to release downsampling code. You are correct that the operation is not trivial because interpolations such as linear are not aware of edges or “holes” in the depth map (we follow the standard of using zeroes for that). The simplest solution is to use nearest-neighbor interpolation to avoid the hallucinated depths, though it might result in some “jaggedness“ of the downsampled depth map. Thank you and sorry

arik1089 commented 2 years ago

Closing the issue for now, thanks.