CDCgov / prime-reportstream

ReportStream is a public intermediary tool for delivery of data between different parts of the healthcare ecosystem.
https://reportstream.cdc.gov
Creative Commons Zero v1.0 Universal
72 stars 40 forks source link

Identify any loss of data when processing COVID samples through FHIR Engine #6757

Closed carlosfelix2 closed 1 year ago

carlosfelix2 commented 2 years ago

User Story:

As a developer, I want to know if COVID data samples used in the COVID pipeline result in data loss from using our current base schema in the FHIR engine, so I can document the missing data and create new issues to resolve them.

Description/Use Case

We need to use COVID data samples to find out if our configuration is missing anything. Chances are we will see some data we are not converting and will need to add those fields to the respective configs.

Risks/Impacts/Considerations

Dev Notes:

Acceptance Criteria

JessicaWNava commented 1 year ago

We discussed this as a team and to validate this we want to use prime-router/src/testIntegration/resources/datatests/HL7_to_INTERNAL/CA-20211001-sully.hl7

Start out with sending this through the UP and comparing the data before and after, make sure it is all there. The suggestion was using transforms like the default sending transform paired with the Colorado receiver transform.

Then, run it through the COVID pipeline for Colorado and compare output. Likely this will expose the gap created by the covid-19 schema existing in the covid pipeline and the lack of an equivalent disease transform in the UP. This then gets into the question of whether or not disease transforms should be a thing which may need to be answered as part of this ticket.