daniilidis-group / m3ed

M3ED Dataset
39 stars 3 forks source link

The ratio of inf pixels in depth map is big. #2

Closed HTLeoo closed 1 year ago

HTLeoo commented 1 year ago

Hi, authors, I notice that the ratio of invalid depth pixels is too big. I use ‘car_urban_night_rittenhouse_gt’ and 'car_urban_night_city_hall_gt' as examples.

I use the code below to compute the number of invalid depth maps.

for i in tqdm(range(len(gt_f['depth/prophesee/left']))):
    depth = gt_f['depth/prophesee/left'][i] #(720, 1280)
    if np.sum(depth == np.inf)/(720*1280) > 0.99:
        invalid_depth_count+=1
print(invalid_depth_count)

The two results are both the lengths of the sequence.

fcladera commented 1 year ago

Hi @HTLeoo

Depth pixels are quite sparse, as they are captured with a rotating Lidar that has 64 vertical channels. We have added depth videos in the download section of the dataset:

https://m3ed.io/download/

For instance, this is a sample sequence.

You may create a mesh from the LiDAR PC if you intend to use it in your algorithm. We decided not to do it as Lidar (in the GT file) is intended to be used as ground truth.