search

SysCV / shift-dev

SHIFT Dataset DevKit - CVPR2022
https://www.vis.xyz/shift
MIT License
103 stars 10 forks source link

Depth maps for the video dataset #8

Closed amitshomer closed 2 years ago

amitshomer commented 2 years ago

Hi,

Is the depth maps existing for the video dataset (10 fps)? Because it's not listed on your website as available.

Thanks

mattiasegu commented 2 years ago

Hi @amitshomer! Currently we haven't uploaded the depth maps for the videos on the websites, as they would take ~2TB per view (~12TB for all cameras).

However, the images/ folder provides a subsampled version at 1 fps of the 10 fps videos, meaning that the depth maps provided there can be matched to frames in the videos.

Do you have a use case for which the 10 fps depth is important? We figured that for most applications the 1 fps depth would be enough, but I'm curious to know whether there is any application for which 10 fps is necessary. If so, we might consider releasing the depth for the front stereo camera pair.

amitshomer commented 2 years ago

Hi @mattiasegu,

Right now, I'm using the 1fps depth maps.

In answer to your question, yes. I'd use the 10 fps depth data if it was available. I have some applications where I'm trying to estimate depth with temporal stability between frames. Basically, I'm trying to simulate my expirements as close as possible to real data (for example kitti LiDAR is 10fps). With only 1 fps, moving objects can have a significant gap between frames.

For the practical problem, I agree that 2TB for view is a lot. That would be awesome if you planned to upload this and if you could separate each view into a several files.

Thanks for the quick response and the great data. Amit

mattiasegu commented 2 years ago

Thanks for the details @amitshomer, I see why you are interested in the 10fps depth maps.

We were already planning to release the LiDAR at 10fps (soon), as it shouldn't take much space. Maybe that will be useful for your use case.

We will have an internal discussion on also uploading the 10 fps depth maps and see if we can find a solution!

suniique commented 2 years ago

Hey @amitshomer, thanks again for your interest in our dataset! We have resolved the space issue and uploaded the LiDAR pointclouds data as well as the 10fps depth videos for all views. You can find them on Download page. Should there be any other issues regarding the data, please tell us!