aws / aws-sdk-java-v2

The official AWS SDK for Java - Version 2
Apache License 2.0
2.21k stars 854 forks source link

Sagemaker library is abusively big 33mb #5687

Open rlconst opened 11 months ago

rlconst commented 11 months ago

Describe the feature

Out of 33mb especially software\amazon\awssdk\services\sagemaker\model is 27mb

Use Case

lambda has 256mb limit and I'm struggling to deply everything I needed. After investigation I found that the main contributor to the size is sagemaker library

Proposed Solution

It makes sense to split sagemaker library to several libraries

Other Information

No response

Acknowledgements

AWS Java SDK version used

2.21.13

JDK version used

17

Operating System and version

al2

debora-ito commented 11 months ago

Out of 33mb especially software\amazon\awssdk\services\sagemaker\model is 27mb

That is the extracted size though, the full sagemaker-2.21.13.jar is 10.6 MB, which is still large when compared to most of the Java SDK modules.

But I see your point. This is an issue not only with the Java SDK v2 but with other language SDKs as well (EC2 is another module that stands out - https://github.com/aws/aws-sdk-go-v2/issues/2871). A definitive solution requires coordination between the service team and the SDK team, and this will take some time.

Increasing module size is a problem that is in the SDK team radar. We appreciate your patience while we work on a long-term solution.

rlconst commented 11 months ago

@debora-ito I count extracted size because aws lambda limits extracted size specifically.

Anyway, thank you

debora-ito commented 3 weeks ago

Transferring this to the Java SDK v2 repo.