awslabs / python-deequ

Python API for Deequ
Apache License 2.0
669 stars 131 forks source link

Data freshness metric #205

Open vandanavk opened 1 month ago

vandanavk commented 1 month ago

Is your feature request related to a problem? Please describe. I did not find Data freshness metric in the list of Analyzers. We would need this to verify we have the latest data

Describe the solution you'd like An analyzer in deequ and pydeequ that can check data for staleness by days, hours, minutes

Describe alternatives you've considered Considered using Python code to determine freshness but its probably more optimized in deequ (Scala)