search

opensearch-project / OpenSearch

🔎 Open source distributed and RESTful search engine.
https://opensearch.org/docs/latest/opensearch/index/
Apache License 2.0
9.52k stars 1.75k forks source link

[Remote Store] Update AWS SDK version to fix connection acquisition timeout issues #12004

Closed shourya035 closed 4 months ago

shourya035 commented 8 months ago

Describe the bug

We are seeing timeouts in connection acquisition from S3 client thread pool since we are hitting this AWS SDK bug: https://github.com/aws/aws-sdk-java-v2/pull/4066 . This is causing issues with remote uploads when AWS S3 has been setup as the remote store.

The fix has been released with AWS SDK 2.20.86 and above. We would need to update our AWS SDK dependency

Related component

Storage

To Reproduce

N/A

Expected behavior

There shouldn't be any leaking connections

Additional Details

Plugins Please list all plugins currently enabled.

Screenshots If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

Additional context Add any other context about the problem here.

peternied commented 8 months ago

[Triage - attendees 1 2 3] @shourya035 Thanks for noting this, we've gladly welcome a PR that updates the AWS SDK version.

linuxpi commented 7 months ago

@shourya035 can we raise a PR for this?

rramachand21 commented 6 months ago

This needs to be fixed for 2.13

linuxpi commented 4 months ago

[Storage Triage - attendees 1 2 3 4 5 6 7 8 9 10 11 12]

@shourya035 lets link the PR and close this issue.

shourya035 commented 4 months ago

Closing this since the AWS SDK version was updated through: https://github.com/opensearch-project/OpenSearch/pull/12251