Missouri-BMI / OMOP_ON_P_CDM

Apache License 2.0
0 stars 0 forks source link

All Of Us Data Quality Check on MU OMOP CDM #41

Closed shossain-mizzou closed 11 months ago

vasanthi014 commented 1 year ago

@shossain-mizzou Did you work on this? Do you need anything to move forward?

shossain-mizzou commented 1 year ago

We need OMOP data first. I have tested with the test dataset

vasanthi014 commented 1 year ago

OMOP views are accessible by you. You can download it to a SWB and run the DQ program on it.

shossain-mizzou commented 11 months ago

@vasanthi014 , columns needs to be modified in visit_occurrence:

shossain-mizzou commented 11 months ago
shossain-mizzou commented 11 months ago
Screenshot 2023-12-05 at 2 14 15 PM
vasanthi014 commented 11 months ago

All these issues should be fixed now. I would expect NULL's in other columns, I will be revising the ETL to make sure the not NULL columns are addressed but please go ahead and run a report again.

shossain-mizzou commented 11 months ago

Ran on 1000 records per csv. Running on large dataset was talking longer time. We should deal with all the null values first.

Screenshot 2023-12-12 at 12 45 13 PM

shossain-mizzou commented 11 months ago

closing the ticket, we have to check null values though