Closed nishantsingh93 closed 5 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 100.00%. Comparing base (
19ed71a
) to head (5faef7f
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Description
This change introduces range comparison for Aggregation Data Quality expectation. A user can now provide valid SQL expression to compare upper_bound and lower_bound check against a measure
Related Issue
https://github.com/Nike-Inc/spark-expectations/issues/81
Motivation and Context
This feature request is to enhance the Aggregation Data quality to accept a range expression. There are two types of valid SQL expression that are supported.
between lower_bound and upper_bound
>lower_bound and <upper_bound
Example:
1) sum(sales) between 1000 and 10000 2) sum(sales)>1000 and sum(sales)<10000
How Has This Been Tested?
sample_dq_iceberg.py
andsample_dq_delta.py
true
and does not touch any other functionalities of the codeScreenshots (if appropriate):
Types of changes
Checklist: