Direct access Rosbags on S3

Ford / AVData

Autonomous Vehicle Seasonal Dataset

MIT License

293 stars 68 forks source link

Direct access Rosbags on S3 #14

Closed wiegelmann closed 1 year ago

wiegelmann commented 4 years ago

Is it possible to put the Rosbags in a non-zipped form on S3, just the .bag files?

We have a bunch of analytics tools that can parse and read Rosbags directly on S3 w/o copying and converting. Makes sense if you process petabytes of bags per day, exploring the data and searching for edge cases.

Many thanks for your release of public AV data! That helps a lot.

ankitvora7 commented 4 years ago

Hi @wiegelmann, the rosbags were zipped so that it is easier/quicker for us to upload and users to download. Let us internally discuss and get back to you on the feasibility of uploading direct rosbags.