search

aws / aws-sdk

Landing page for the AWS SDKs on GitHub
https://aws.amazon.com/tools/
Other
68 stars 12 forks source link

Sagemaker library is abusively big 33mb #661

Open rlconst opened 7 months ago

rlconst commented 7 months ago

Describe the feature

Out of 33mb especially software\amazon\awssdk\services\sagemaker\model is 27mb

Use Case

lambda has 256mb limit and I'm struggling to deply everything I needed. After investigation I found that the main contributor to the size is sagemaker library

Proposed Solution

It makes sense to split sagemaker library to several libraries

Other Information

No response

Acknowledgements

AWS Java SDK version used

2.21.13

JDK version used

17

Operating System and version

al2

debora-ito commented 7 months ago

Out of 33mb especially software\amazon\awssdk\services\sagemaker\model is 27mb

That is the extracted size though, the full sagemaker-2.21.13.jar is 10.6 MB, which is still large when compared to most of the Java SDK modules.

But I see your point. This is an issue not only with the Java SDK v2 but with other language SDKs as well (EC2 is another module that stands out - https://github.com/aws/aws-sdk/issues/618). A definitive solution requires coordination between the service team and the SDK team, and this will take some time.

Increasing module size is a problem that is in the SDK team radar. We appreciate your patience while we work on a long-term solution.

rlconst commented 7 months ago

@debora-ito I count extracted size because aws lambda limits extracted size specifically.

Anyway, thank you