search

Galileo-Galilei / kedro-pandera

A kedro plugin to use pandera in your kedro projects
https://kedro-pandera.readthedocs.io/en/latest/
Apache License 2.0
34 stars 5 forks source link

Temporarily deactivate runtime validation #27

Open Galileo-Galilei opened 1 year ago

Galileo-Galilei commented 1 year ago

Description

TBD

Context

TBD

Possible Implementation

TBD

kedro run --pandera.off CLI flag would be nice, but it is not currently possible to add flags to the CLI via plugins

noklam commented 1 year ago

Cannot find the related issue so i just post it here

From the pandera author about the env variable to disable runtime check.

hi <@678216302443233306> so a validation on/off switch was introduced with the latest pyspark sql integration: https://pandera.readthedocs.io/en/latest/pyspark_sql.html#switching-validation-on-and-off

But currently it only works for the pyspark.sql integration. Would you mind opening up an issue to add support for this in pandas validation?

Galileo-Galilei commented 5 months ago

It is now possible in pandera>=0.17.3: https://pandera.readthedocs.io/en/stable/configuration.html#validation-depth

noklam commented 5 months ago

Indeed, I actually made the PR 😁 https://github.com/unionai-oss/pandera/pull/1354