awslabs / python-deequ

Python API for Deequ
Apache License 2.0
713 stars 134 forks source link

External Json interface to define constraints #103

Open sidharthbolar opened 2 years ago

sidharthbolar commented 2 years ago

Is your feature request related to a problem? Please describe. The library provides excellent capabilty to run data quality rules at scale However it would be great if the caller could define all the constraints in an external json to decouple the actual rules from the code

Describe the solution you'd like Provide an interface to provide a json of multiple constraints that could be applied to datasets

Describe alternatives you've considered At this stage tge proposed feature is still high level

Additional context Providing a further abstraction of maintaining the dq rules will enable a more wider audience to create them and increase usage

sidharthbolar commented 2 years ago

I would be happy to work on this request and subsequently a provide initial draft solution before proceeding with actual implementation and docs