ydataai / ydata-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
https://docs.profiling.ydata.ai
MIT License
12.44k stars 1.68k forks source link

Great_expectation: incompatible with config version 3.0 due to missing action_list_operator #769

Open mvanuyt opened 3 years ago

mvanuyt commented 3 years ago

Describe the bug When utilizing the great_expectation integration with the newest great_expectation config version, you receive the following error: DataContextError: No validation operator action_list_operator was found in your project. Please verify this in your great_expectations.yml Originating from

[...]pandas_profiling/expectations_report.py", line 100, in to_expectation_suite
    results = data_context.run_validation_operator(

To Reproduce Running example 1 from https://github.com/pandas-profiling/pandas-profiling/blob/develop/examples/features/great_expectations_example.py using below versions

Version information: Python 3.8.2 great_expectations 0.13.19 (with config_version: 3.0) pandas_profiling 2.11.0

Additional context Error can be circumvented by adding the following code to great_expectations.yml after init, but this will give a depreciation error when using the new config version of great_expectations:

validation_operators:
  action_list_operator:
    class_name: ActionListValidationOperator
    action_list:
    - name: store_validation_result
      action:
        class_name: StoreValidationResultAction
    - name: store_evaluation_params
      action:
        class_name: StoreEvaluationParametersAction
    - name: update_data_docs
      action:
        class_name: UpdateDataDocsAction
CodeCox commented 2 years ago

Still an issue for the basic example code in docs:

Version information:

Python 3.9.9
great_expectations 0.13.46 
pandas_profiling 3.1.0

The hack mentioned by the OP is still required to get pass this issue!

I'm new to this integration feature so it was quite a serious stumbling block for me - it's reasonable to expect this initial integration example to work without intervention?

zivshapiraintel commented 2 years ago

This is still an issue in version 0.14.8 of great_expectations and pandas_profiling 3.1.0 The hack mentioned by the OP is still required to get pass this issue

marco-santulli commented 1 year ago

Hi,

sorry not sure if this is the right issue to write into, but I wanted to raise two things:

  1. the documentation tutorial refers to a version of Great Expectations before 1.13.8 (Jan 28, 2021). The sympthom is the one in the title of this issue.
  2. some of the expectations generated by pandas-profiling are incompatbile with the current version of GE si they raise errors when generated.

maybe it would be good to do an upgrade to one of the more recent versions of GE?

M