CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository
8 stars 4 forks source link

End-of-support for Java v1.x AWS SDK - December 31, 2025 #1972

Open dloy opened 1 month ago

dloy commented 1 month ago

Current java S3 support in Merritt uses version 1 AWS SDK. Through most of 2022-23 v2 provided a fraction of the features in v1. This has changed and with the dropped support of 12/31/2025, it is now critical that version 1 be upgraded to version 2. As of July 31, 2024, v1 is maintenance mode only.

The impacts of these changes need to be explored since this underlying code is used in Storage, Audit and Replication. Hopefully(!) the existing API can continue with the underlying code replaced but the details need to be evaluated.

terrywbrady commented 1 month ago

https://aws.amazon.com/blogs/developer/announcing-end-of-support-for-aws-sdk-for-java-v1-x-on-december-31-2025/

martinhaye commented 1 month ago

David added this info in a request to Kurt: "I became aware that AWS is freezing their version 1 of the java S3 sdk in 2025. We use this code for all of our server s3 handling (AWS, SDSC, and Wasabi). There is some complexity in the retry logic that required several failed attempts to get this code working especially with SDSC and Wasabi. Would it be inappropriate to request that our AWS rep. see if the AWS v2 group could provide the equivalent for this block of v1 code I have?"

Let's discuss and get the retry code to IAS, so that we can discuss with Kevin and company.

terrywbrady commented 1 month ago

Discussed at 7/23 IAS meeting

dloy commented 1 month ago

Response SDSC from Gavin Biffar: Hi David,

Sorry for the delay. Qumulo tells me there are no major caveats with the AWS Java SDK v2. The key requirements are to use path-style addressing and enable signature v4 signing.

Thanks, Gavin

dloy commented 1 month ago

From Wasabi: From Denis at Wasabi:

In the interim, please find this KB article on version 2 of the Wasabi sdk:

https://docs.wasabi.com/docs/how-do-i-use-aws-sdk-for-java-v2-with-wasabi?highlight=aws%20s3%20java

and this one too.

https://docs.wasabi.com/docs/aws-1

Kind regards, Denis