kedro-org / kedro-plugins

First-party plugins maintained by the Kedro team.
Apache License 2.0
93 stars 89 forks source link

Problem creation a partitions.PartitionedDataSet #679

Closed Premji98 closed 5 months ago

Premji98 commented 5 months ago

Description

I am using kedro (version 0.19.5)

I am trying to create this dataset on top of ImageDataSet provided in the official documentation. This gives me error saying "Class 'partitions.PartitionedDataset' not found, is this a typo?"

Context

I am trying to build a PartitionedDataSet of Images(png). I followed the official documentation on 'pikachu' dataset.

Steps to Reproduce

  1. dataset_raw:
    type: partitions.PartitionedDataset
    path: data/01_raw  # path to the location of partitions
    dataset: cct_kedro.datasets.image_dataset.ImageDataset  # shorthand notation for the dataset which will handle individual 
    filename_suffix: ".png"

Expected Result

pipeline should run normally

Actual Result

DatasetError

![image](https://github.com/kedro-org/kedro-plugins/assets/145099321/1fc76060-0ff1-4124-9ea0-80b7397e0395)

Your Environment

Include as many relevant details about the environment in which you experienced the bug: virtual env with python 3.12

ankatiyar commented 5 months ago

Hey @Premji98, we've moved PartitionedDataset and IncrementalDataset to the kedro-datasets package since v19.0 of Kedro I believe, you'd also need to install kedro-datasets to be able to use these datasets, does that solve your problem?

Premji98 commented 5 months ago

Yes @ankatiyar pip install kedro-datasets did it. This solved the issue. Thank you