search

mapbox / cardboard

tile indexed geo database interface.
ISC License
52 stars 10 forks source link

Retry unprocessed items #170

Closed rclark closed 8 years ago

rclark commented 8 years ago

Currently if cardboard makes a batch write request to DynamoDB, and unprocessed items are returned cardboard does not attempt to retry those items. This "error" may or may not be handled well downstream.

The untagged, master branch of dyno contains new functions intended to do this retrying for you. We should try it out here in cardboard.

cc @mcwhittemore

mcwhittemore commented 8 years ago

@rclark unprocessed items are from dynamo rate limits right? Won't retrying this just result in the same result?

rclark commented 8 years ago

Unprocessed items are from throughput limiting or "internal server errors". The suggestion from DynamoDB docs is to always retry unprocessed items with exponential backoff.

Come to think of it, the new functions in dyno don't backoff, but they should right about here.