National-COVID-Cohort-Collaborative / Data-Ingestion-and-Harmonization

Data Ingestion and Harmonization
41 stars 12 forks source link

site are sending in visit_occurrence data with person not in the person table #74

Closed stephanieshong closed 2 years ago

stephanieshong commented 3 years ago

Sites are sending in visit_occurrence data with person_id not found in the person table.

stephanieshong commented 3 years ago

If sites send in visit_occurrence data with person_id not found in the person table then those visits are not included in the final dataset built from the pipeline. Similar checks are also performed for all other domains. Only the data from each domain with valid person_id found in the person table are included in the merged LDS dataset.

stephanieshong commented 3 years ago

Additionally, if the sites are sending in domain data with reference to a person not found in the person table, those data are excluded.