openaddresses / openaddresses-ops

Issues-only repo for discussion of operational considerations for OA
6 stars 5 forks source link

Data Mirrors #28

Closed buildscientist closed 4 years ago

buildscientist commented 4 years ago

Hello,

Thank you for all the time and effort you put into managing this free data set.

I was wondering if there are any mirrors to https://data.openaddresses.io/ ? I'm not sure if the data is backed by AWS S3 but download times seem to fairly long due to throttling.

I understand that this may be deliberate because this is donor funded project but has any thought been put into creating official mirrors of the data set?

iandees commented 4 years ago

The data is stored on S3, yep. Downloads via data.openaddresses.io HTTPS are throttled to reduce bandwidth costs.

If you're on AWS, you can use the requester pays S3 feature to download directly from the data.openaddresses.io bucket.