[CI] S3BlobContainerRetriesTests testReadRetriesAfterMeaningfulProgress failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #4817 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4812 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4802 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4777 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4772 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4767 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4737 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4732 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4722 / openjdk23_checkpart1_java-matrix
• elasticsearch-periodic #4712 / openjdk23_checkpart1_java-matrix

Reproduction Line:

./gradlew ':modules:repository-s3:test' --tests "org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests.testReadRetriesAfterMeaningfulProgress" -Dtests.seed=B3905FCE37BA801F -Dtests.locale=ar-EH -Dtests.timezone=America/Los_Angeles -Druntime.java=23

Applicable branches: 8.15

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupState:(initialChildControlState:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:task.keyword,order:0,selectedOptions:!(),title:'GradleTask',type:optionsListControl),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:className.keyword,order:1,selectedOptions:!(org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests),title:'Suite',type:optionsListControl),'144933da-5c1b-4257-a969-7f43455a7901':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:name.keyword,order:2,selectedOptions:!(testReadRetriesAfterMeaningfulProgress),title:'Test',type:optionsListControl)))))

Failure Message:

com.amazonaws.SdkClientException: Unable to execute HTTP request: The target server failed to respond

Issue Reasons:

• [8.15] 2 consecutive failures in step openjdk23_checkpart1_java-matrix
• [8.15] 10 failures in test testReadRetriesAfterMeaningfulProgress (1.6% fail rate in 627 executions)
• [8.15] 10 failures in step openjdk23_checkpart1_java-matrix (45.5% fail rate in 22 executions)
• [8.15] 10 failures in pipeline elasticsearch-periodic (45.5% fail rate in 22 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-distributed-coordination (Team:Distributed Coordination)

[ywangd]

Similar to https://github.com/elastic/elasticsearch/issues/115583. Will backport the fix #115177

[ywangd]

https://github.com/elastic/elasticsearch/pull/116556