ValueError: Must install dask-expr to activate query planning

[khaeru]

Occurs here when importing pyam, via (among others)

• pyam-iamc 2.1.0,
• ixmp4 0.7.2 (the bug may be properly targeted there; I'm not sure),
• pandera 0.18.3, and
• dask 2024.3.0.

This distinct package was announced in December: https://docs.dask.org/en/latest/changelog.html#logical-query-planning-now-available-for-dask-dataframes in 2023.12.1. This error appears to be new with 2024.3.0, which was released today.

  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/genno/compat/pyam/__init__.py", line 2, in <module>
    import pyam  # noqa: F401
    ^^^^^^^^^^^
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pyam/__init__.py", line 18, in <module>
    from pyam.iiasa import read_iiasa, lazy_read_iiasa  # noqa: F401
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pyam/iiasa.py", line 27, in <module>
    import ixmp4
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/ixmp4/__init__.py", line 4, in <module>
    from ixmp4.core import Model as Model
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/ixmp4/core/__init__.py", line 2, in <module>
    from .iamc.variable import Variable as Variable
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/ixmp4/core/iamc/__init__.py", line 3, in <module>
    from .data import RunIamcData, PlatformIamcData
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/ixmp4/core/iamc/data.py", line 4, in <module>
    import pandera as pa
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pandera/__init__.py", line 4, in <module>
    import pandera.backends
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pandera/backends/__init__.py", line 6, in <module>
    import pandera.backends.pandas
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pandera/backends/pandas/__init__.py", line 5, in <module>
    import pandera.typing
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pandera/typing/__init__.py", line 9, in <module>
    from pandera.typing import (
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/pandera/typing/dask.py", line 9, in <module>
    import dask.dataframe as dd
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/dask/dataframe/__init__.py", line 87, in <module>
    if _dask_expr_enabled():
       ^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/actions-runner/_work/_tool/Python/3.11.2/x64/lib/python3.11/site-packages/dask/dataframe/__init__.py", line 24, in _dask_expr_enabled
    raise ValueError("Must install dask-expr to activate query planning.")
ValueError: Must install dask-expr to activate query planning.

[danielhuppmann]

This is indeed an issue related to ixmp4, https://github.com/iiasa/ixmp4. Note that the issue can’t be transferred because it belongs to a different organization. Please close and open a corresponding issue there.

[glatterf42]

Taking care of this with this PR: https://github.com/iiasa/ixmp4/pull/61

[glatterf42]

Should be resolved by ixmp4 v0.7.3.