CDCgov / data-exchange-hl7

Enterprise Data Exchange (DEX) is a new cloud-native centralized data ingestion, validation, and observation service scoped for common data types (HL7, FHIR, CDA, XML, CSV) sent to the CDC. It helps public health stakeholders who send data to the CDC while reducing the maintenance efforts, complexity, and duplication of ingestion points to CDC.
Apache License 2.0
10 stars 14 forks source link

Business Requirements for process orchestration #20

Open dcdlz opened 2 years ago

dcdlz commented 2 years ago

Context

HL7 message processing follows the same general flow...

  1. Receive/Debatch
  2. Redact
  3. Structure Validate (with NIST IGAMT)
  4. Normalize to a Data Product

The application code for (1), (2) and (3) should be identical for all HL7v2 messages. For the pedants:

However, the normalize to data product will differ depending on the purpose of the HL7v2 message. For example Case Notification messages vs Laboratory messages

Requirements

1) We should be able to orchestrate functions into pipelines, such that the pipelines can i) change and ii) reuse Functions

rmharrison commented 1 year ago

Solutioning: Orchestration

Current state: Orchestrated from EventHub queues.

Potential options for "config-based" orchestration...