search

awslabs / python-deequ

Python API for Deequ
Apache License 2.0
713 stars 134 forks source link

Add support for datetime/date datatypes and columns #82

Open jeanineharb opened 2 years ago

jeanineharb commented 2 years ago

Is your feature request related to a problem? Please describe. I would like to run data quality checks such as Maximum() or Minimum() on datetime columns (DateType or Timestamp type in Spark).

Describe the solution you'd like Add support for datetime columns in the API (ConstrainableDataTypes, Analyzers, Profilers).

Describe alternatives you've considered I'm currently converting datetime columns to a numeric datatype (unix_timestamp), but it would be great if we could use the API on the original columns, in order to avoid conversion bugs/issues.

Thanks for considering my request! 🙂

revolutionisme commented 1 year ago

Hi, is python-deequ maintained currently? We would like to use this to check the datatype, if this is not maintaned, is there an alternative?