search

openaddresses / openaddresses-ops

Issues-only repo for discussion of operational considerations for OA
6 stars 5 forks source link

increase s3 max file size #22

Open andrewharvey opened 6 years ago

andrewharvey commented 6 years ago

EntityTooLarge Your proposed upload exceeds the maximum allowed size 629145600

It seems the upload limit for https://results.openaddresses.io/upload-cache is around 600MB, I'm trying to upload a 1GB file for https://github.com/openaddresses/openaddresses/pull/3913.

Could the limit be increased?

PS. It was discussed in the past, but if overall S3 cache size becomes an issue I'm in favour of only caching the latest for any source.

ingalls commented 6 years ago

cc/ @migurski @iandees