aws / sagemaker-python-sdk

A library for training and deploying machine learning models on Amazon SageMaker
https://sagemaker.readthedocs.io/
Apache License 2.0
2.11k stars 1.14k forks source link

Relax cloudpickle requirement #4871

Open aaravind100 opened 2 months ago

aaravind100 commented 2 months ago

Describe the feature you'd like Relax cloudpickle requirement from being pinned to 2.2.1, which was released on Jan 2023. The recent version is 3.0.0 released on Oct 2023.

How would this feature be used? Please describe. To install and use other dependencies which require newer couldpickle along with sagemaker sdk.

Describe alternatives you've considered NA

Additional context NA

jameslamb commented 1 month ago

+1 to this. To add another reason to move... the latest version of distributed (2024.9.0) requires cloudpickle>=3.0.0 (code link).

So it's no longer possible to install the latest Dask packages and sagemaker-python-sdk in the same environment.

aaravind100 commented 1 week ago

is there a blocker for updating it? i see the pr #4902 is reverted

jakirkham commented 1 week ago

^ @liujiaorr do you know?