search

aws / aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
https://aws-sdk-pandas.readthedocs.io
Apache License 2.0
3.94k stars 701 forks source link

Support modin 0.32 #3003

Closed allemp closed 4 weeks ago

allemp commented 4 weeks ago

Describe the bug

Currently the supported versions of modin are (>=0.31.0,<0.32.0) which doesn't include the newest version of modin which is 0.32

How to Reproduce

*P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.*

Expected behavior

I expected awswrangler to support the newest version of modin.

Your project

No response

Screenshots

No response

OS

linux

Python version

not applicable

AWS SDK for pandas version

not applicable

Additional context

No response

jaidisido commented 4 weeks ago

In the requirements file, modin is not constrained to a minor version as the carat specification constrains to major versions. In other words, modin 0.32.0 is allowed.

However, pip does not always select the latest version of a dependency by default as it is subject to the dependency tree that it resolves. In this case, it resolves to 0.31.0.

You can nonetheless force upgrade to the latest modin version yourself:

pip install awswrangler modin==0.32.0 ray==2.36.1