search

nmandery / rout3serv

H3-grid based Routing server with GRPC-API and dataframe integration
0 stars 0 forks source link

Deduplicate requests based on S3 key in S3 dataset loader #2

Closed nmandery closed 3 years ago

nmandery commented 3 years ago

To prevent making multiple requests to the same file in case the dataset is not split across multiple files.

https://github.com/nmandery/route3/blob/55faba2ffbada6372a9aa22b850316bcbd4c8179/route3_road/src/io/s3.rs#L304