Tuning AWS Java SDK HTTP request settings for latency-aware Amazon DynamoDB applications

[AdrianHu99]

https://aws.amazon.com/blogs/database/tuning-aws-java-sdk-http-request-settings-for-latency-aware-amazon-dynamodb-applications/

[AdrianHu99]

• ConnectionTimeout ConnectionTimeout is the maximum amount of time that the client waits for the underlying HTTP client in the SDK to establish a TCP connection with the DynamoDB endpoint.
• ClientExecutionTimeout ClientExecutionTimeout is the maximum allowed total time spent to perform an end-to-end operation and receive the desired response, including any retries that might occur.
• RequestTimeout RequestTimeout is the time it takes for the client to perform a single HTTP request. RequestTimeout is measured from the moment that a DynamoDB API call (such as PutItem or GetItem) is made until a response is received from the service. Logically, the value of this timeout should be less than the ClientExecutionTimeout.
• SocketTimeout SocketTimeout defines the maximum amount of time that the HTTP client waits to read data from an already established TCP connection. This is the time between when an HTTP POST ends and the entire response of the request is received, and it includes the service and network round-trip times.
• the DynamoDB default retry policy for HTTP API calls with a custom maximum error retry count The default retry policy available in the AWS Java SDK for DynamoDB is a good starting point to define client-side retry strategies for the underlying HTTP client. The default policy starts with a maximum of 10 retries with a predefined base delay of 25 milliseconds for any 5XX server-side exceptions (such as “HTTP status code – 500 Internal Server Error” or “HTTP status code – 503 Service Unavailable”), and 500 milliseconds for any 4XX client-side exceptions (such as “HTTP status code 400 – ProvisionedThroughputExceededException”).

[AdrianHu99]

public static int connectionTimeout = 50; // 50 ms
public static int clientExecutionTimeout = 100; // 100 ms
public static int requestTimeout = 20; // 20 ms
public static int socketTimeout = 25; // 25 ms
public static int maxErrorRetries = 5;

[AdrianHu99]

Another example: public static int connectionTimeout = 50; // 50 ms public static int clientExecutionTimeout = 1000; // 1 s public static int requestTimeout = 500; // 500 ms public static int socketTimeout = 550; // 550 ms public static int maxErrorRetries = 3;