Minyus / pipelinex

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more
https://pipelinex.readthedocs.io/
Other
221 stars 11 forks source link

ModuleNotFoundError: No module named 'kedro.io.transformers' #16

Open Peccer opened 1 year ago

Peccer commented 1 year ago

Seems to use a deprecated transformer function from kedro.

Reference: https://kedro.readthedocs.io/en/0.17.0/07_extend_kedro/06_transformers.html

Output when running main.py from terminal

╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ /work/pipelinex_causallift/main.py:2 in │ │ │ │ 1 from pathlib import Path │ │ ❱ 2 from pipelinex import version, configure_source, FlexibleContext │ │ 3 │ │ 4 │ │ 5 if name == "main": │ │ │ │ /root/venv/lib/python3.9/site-packages/pipelinex/init.py:13 in │ │ │ │ 10 │ │ 11 if find_spec("kedro"): │ │ 12 │ from .extras.hooks.add_catalog_dict import # NOQA │ │ ❱ 13 │ from .extras.hooks.add_transformers import # NOQA │ │ 14 │ from .flex_kedro.configure import # NOQA │ │ 15 │ from .flex_kedro.context.flexible_context import # NOQA │ │ 16 │ from .flex_kedro.pipeline.pipeline import * # NOQA │ │ │ │ /root/venv/lib/python3.9/site-packages/pipelinex/extras/hooks/add_transformers.py:4 in │ │ │ │ 1 from typing import List, Tuple, Union │ │ 2 │ │ 3 from kedro.io import DataCatalog │ │ ❱ 4 from kedro.io.transformers import AbstractTransformer │ │ 5 │ │ 6 try: │ │ 7 │ from kedro.framework.hooks import hook_impl │ ╰──────────────────────────────────────────────────────────────────────────────────────────────────╯ ModuleNotFoundError: No module named 'kedro.io.transformers'

Minyus commented 1 year ago

Hi @Peccer ,

Thank you for reporting the issue. As you pointed out, PipelineX does not support kedro 0.18.x yet. Could you install kedro 0.17.x ?

pip install kedro==0.17.7

Pull requests for fix are welcomed.

Minyus commented 1 year ago

I released pipelinex 0.7.6 which does not import modules missing in kedro 0.18.x to avoid the error.