Update NEON ETL for nmdc-schema 10.0.0

microbiomedata / nmdc-runtime

Runtime system for NMDC data management and orchestration

https://microbiomedata.github.io/nmdc-runtime/

Other

4 stars 3 forks source link

Update NEON ETL for nmdc-schema 10.0.0 #452

Open aclum opened 5 months ago

aclum commented 5 months ago

There have been changes in how quality information is modeled. We need to:

[ ] update how we populate extraction_set records (quality_control_report.status should now be qc_status) see example data here
[ ] Add qc_status values to omics_processing_set records so the workflows know they should not process the data.

10.0.0 is on runtime dev currently and is planned to be released to runtime prod on 1/29/2024

cc @pkalita-lbl

pkalita-lbl commented 5 months ago

Discussed this with @sujaypatil96. Since this pipeline isn't run in deployed environments (i.e. running release-tagged code) it's not critical to have this fixed before the 2024.1 production release.