NOAA-PMEL / iot-data-landing

IoT Data Landing Project
The Unlicense
0 stars 0 forks source link

Add a QC knative app and integrate with erddap-insert #20

Closed kwilcox closed 2 years ago

kwilcox commented 2 years ago

This allows ioos_qc to be run on data flowing through the Knative broker. It uses ioos_qc YAML configuration files stored in an S3 API compatible object store to drive the QC checks. The QC checks are added as a new ERDDAP dataset alongside the original data. The new datasets in ERDDAP include the original (unmodified) data and adds columns for each QC check performed and an aggregate rollup QC flag for the entire record.