search

FRosner / drunken-data-quality

Spark package for checking data quality
Apache License 2.0
222 stars 69 forks source link

access check results in dataframe #150

Closed jamiegeyer closed 5 years ago

jamiegeyer commented 5 years ago

Is it possible to just push check results to a dataframe, then I can do whatever I want with it?

FRosner commented 5 years ago

There was https://github.com/FRosner/drunken-data-quality/issues/95 and even some discussions around that (https://github.com/FRosner/drunken-data-quality/pull/99) but it was never finished.

Independently of that you can programatically access the check results as described here: https://github.com/FRosner/drunken-data-quality#unit-tests

jamiegeyer commented 5 years ago

Thanks for the quick response and your work on this - it's a great tool.