search

b-r-u / osmpbf

A Rust library for reading the OpenStreetMap PBF file format (*.osm.pbf).
Apache License 2.0
122 stars 19 forks source link

Async blob reader #48

Open brad-richardson opened 2 months ago

brad-richardson commented 2 months ago

As described in #47, adds support for async streaming of OSM PBFs. Using object_store as the input interface for flexibility - it supports most cloud providers, HTTP, and local files.

Example usage in docs and here: https://github.com/brad-richardson/osm-pbf-parquet/pull/15/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759R116

b-r-u commented 2 months ago

Thanks for this PR! Could you add a simple test to https://github.com/b-r-u/osmpbf/blob/main/tests/read.rs ? Just like read_blobs() but using the AsyncBlobReader.

brad-richardson commented 1 month ago

@b-r-u I've updated with the requested test and fixed the issues from the first test run. Could you rerun and give me another review? Thanks!