Added ColumnValues to Row-level Results

awslabs / deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Apache License 2.0

3.32k stars 539 forks source link

Added ColumnValues to Row-level Results #476

Closed zixianzh1 closed 1 year ago

zixianzh1 commented 1 year ago

Issue #, if available:

Description of changes: Add Max, Min, PatternMatch to rowlevel results Change the null behavior back

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

torontoairbnb commented 1 year ago

hi @mentekid I can see this PR mereged to master and PatternMatch and min max record level has been added, I have tested the verificationSuiteTest piece of code but only two rules result showing in thev rowLevelResultAsDataFrame which are for isComplete and completeness and not the new rules