man-group / ArcticDB

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.
http://arcticdb.io
Other
1.52k stars 93 forks source link

Allow customizing the most useful AWS SDK settings. #1875

Closed poodlewars closed 1 month ago

poodlewars commented 1 month ago

ARCTICDB_S3Storage_HttpRequestTimeoutMs_int=3000

suffices to resolve the slowness issues users have been reporting with VAST.

I've given the new settings a default in line with the SDK defaults - https://sdk.amazonaws.com/cpp/api/LATEST/aws-cpp-sdk-core/html/struct_aws_1_1_client_1_1_client_configuration.html .

Similar PR from @IvoDD - https://github.com/man-group/ArcticDB/pull/1872/files