datacontract / datacontract-cli

CLI to manage your datacontract.yaml files
https://cli.datacontract.com
Other
484 stars 94 forks source link

Service Levels Should Perform Tests Natively #407

Open dataGriff opened 2 months ago

dataGriff commented 2 months ago

For the following nodes in the servicelevels datacontract specification:

Tests should automatically occur on the properties available without needing to specify them further in the additional quality node as everything is available to perform these tests without further specification.

retention:
   description: Data is retained for one year
   period: P1Y
   timestampField: model_name.last_updated
   unlimited: false
  latency:
    description: Data is available within 25 hours after the order was placed
    threshold: 1m
    sourceTimestampField: model_name.last_updated
    processedTimestampField: model_name.last_updated
  freshness:
    description: The most recent data in the whiskeys list.
    threshold: 1m
    timestampField: model_name.last_updated
jochenchrist commented 1 month ago

Agree, we should do it. A PR would be appreciated.