crate / cratedb-examples

A collection of clear and concise examples how to work with CrateDB.
Apache License 2.0
8 stars 7 forks source link

Time Series: Incompatibility between Google Colab and pandas 2 #478

Closed wierdvanderhaar closed 2 weeks ago

wierdvanderhaar commented 2 weeks ago

When running timeseries-queries-and-visualization.ipynb in Colab you get the following error when installing the needed pip packages.

!pip install --upgrade kaleido 'pandas>=2' plotly sqlalchemy-cratedb
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
cudf-cu12 24.4.1 requires pandas<2.2.2dev0,>=2.0, but you have pandas 2.2.2 which is incompatible.
google-colab 1.0.0 requires pandas==2.0.3, but you have pandas 2.2.2 which is incompatible.

This can be fixed by running:

!pip install --upgrade kaleido 'pandas==2.0.3' plotly sqlalchemy-cratedb
amotl commented 2 weeks ago

Thanks. Will be fixed with fa5edbd10b46c2, on behalf of GH-482.

amotl commented 2 weeks ago

Google Colab's changelog reports that on 2024-05-13, the cudf package has been included.

Python package inclusions

  • cudf 24.4.1

This apparently wants to pull in pandas=>2.0, [...]

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
cudf-cu12 24.4.1 requires pandas<2.2.2dev0,>=2.0, but you have pandas 1.5.3 which is incompatible.
cudf-cu12 24.4.1 requires pyarrow<15.0.0a0,>=14.0.1, but you have pyarrow 16.1.0 which is incompatible.
google-colab 1.0.0 requires pandas==2.0.3, but you have pandas 1.5.3 which is incompatible.
google-colab 1.0.0 requires requests==2.31.0, but you have requests 2.32.3 which is incompatible.
ibis-framework 8.0.0 requires pyarrow<16,>=2, but you have pyarrow 16.1.0 which is incompatible.

[...] but our "Time Series" stack is not up-to-date to be able to use it, because the update needs to be unblocked.

As outlined on both the ticket and the PR, any support is appreciated.

amotl commented 2 weeks ago

The situation will be improved with:

Upgrading two other notebooks has been postponed: