nodaryio / signed-api

0 stars 0 forks source link

Paginate reading and writing data not to hit DynamoDB limits #22

Closed bdrhn9 closed 1 year ago

bdrhn9 commented 1 year ago

AWS.DynamoDB.DocumentClient.query has 1MB upper limit to retrieve data as seen here. The trivial solution for this problem is pagination of queries according to LastEvaluatedKey in response header from DynamoDB by leveraging ExclusiveStartKey.

Similarly, AWS.DynamoDB.DocumentClient.batchWrite has constraint to limit maximum 25 requests in a batch.