search

sparkutils / quality

A Quality Spark DQ Library
https://sparkutils.github.io/quality/
Apache License 2.0
4 stars 2 forks source link

dataset level aggregates #32

Closed chris-twiner closed 1 year ago

chris-twiner commented 1 year ago

easier wrapping and storage of results via a new type - aggregate results stored as string rather than direct type as evolution of a single column is not going to work and single column is the easiest way to allow expansion of aggregates.

chris-twiner commented 1 year ago

tested on dbr 12.2