search

awslabs / deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Apache License 2.0
3.18k stars 519 forks source link

Is AggregateMatch type check supported in the library? #539

Open chaurasiya opened 4 months ago

chaurasiya commented 4 months ago

Ask questions that don't apply to the other templates (Bug report, Feature request) Hello Guys, I have been looking for some use case where we can generate two aggregate metrics and do the validation of their ratios. Something like this is supported on AWS Glue data quality . Since it is built on top of this library, I was trying to find that check in this library but couldn't find. Can you help me if it is available in this library or I will have to do some customization around the library? @rdsharma26

rdsharma26 commented 4 months ago

It is not supported in Deequ at the moment. We are planning on adding this rule to the repository.