How to download only lidar data for tfrecords

waymo-research / waymo-open-dataset

Waymo Open Dataset

https://www.waymo.com/open

Other

2.67k stars 608 forks source link

How to download only lidar data for tfrecords #839

Open SM1991CODES opened 3 months ago

SM1991CODES commented 3 months ago

Hi, In the new v2 Apache format, we can select only lidar related data and download. Is it possible to do the same for the tfrecords? I could not find a way to do this. There are only train and val splits. The data is huge this way.

JingweiJ commented 2 months ago

TFRecord files are organized by run segment instead of modality. There is no easy way of only downloading LiDAR related data from TFRecord files. (This is a key motivation of v2 parquet file format.)