Data quality gates: detailed configuration for each

[DaveraGabriel]

Needed: a short series of focused meetings between JHU team & representatives of CDMs to develop detailed specification(s) / desired outcome for each of the data quality gates in proposed N3C DI&H workflow. Activities & work products (at each gate) include: a) review of available methods tools b) threshold for pass / fail c) develop failure process d) rule sets / parameters working with selected tools / methods to achieve goals for gate

[DaveraGabriel]

Meetings are scheduled for Tues 5/5, 3pm Fri 5/8, 9am Mon 5/11, 4pm Wed 5/13 3pm Fri 5/15 9am

Rolling Meeting notes can be found here.

[DaveraGabriel]

Notes from OHDSI Data Quality Review meeting - 27Apr.
In order to adopt the OHDSI tooling into the N3C ingestion pipeline:

• Download package from github – Clare will be sending links
• Also take a look at Achilles (chartacterization tool)
• Unrolling the package
• point R to your CDM database
• Optional: will create a table with the results of the schema
• A JSON file will be generated (this can optionally be sent to the submitting site)

[DaveraGabriel]

A minimum data gate proposal was discussed in DQGFG #3, on May 11, 2020

[DaveraGabriel]

Clair Blacketter proposed and led a review of a minimum set of data quality rules based on use of the OHDSI Data Quality Dashboard in DQGFG #4 on May 13, 2020.

[DaveraGabriel]

Series of 5 meetings with DI&H team and CDM stakeholder representation resulted in a detailed workflow that features the following:

• minimum necessary DQ rules
• non-repeating (no duplicate rules)
• distributed across Acquisition, Ingestion and Harmonization steps

[DaveraGabriel]

DQ meetings concluded, outstanding deliverable are detailed documentation re each step. Workflow pertaining to Data Quality Steps is documented here