TIP-Global-Health / eheza-app

Apache License 2.0
3 stars 1 forks source link

Eheza Reports - data anomalies #1247

Closed anvmn closed 3 weeks ago

anvmn commented 1 month ago

Problems:

  1. Initial, there was no Person CT. Instead there were Mother and Child CTs. Person CT has replaced them after ~1.5 years. All Mother and Child nodes were migrated to Person nodes. The problem is that creation date of Person node did not original creation of Child/Mother node. This means that we got 6327 patients with wrong creation date.

  2. Some patients got invalid Geo location fields. This causes patients to be excluded at reports.

    • While there are 3 provinces, there are 10 different values in DB: Selection_706

    • While there are 5 districts, there are 8 different values in DB:

Selection_709

Selection_720

anvmn commented 1 month ago

Invalid Province - 'Parent':

Child with all Geo fields set to Parent':

Selection_707

Got a relationship with mother:

Selection_708

Mother got Geo fields set properly.

Resolution - setting fields per mother.

anvmn commented 1 month ago

Other provinces mapping:

    'AMAJYARUGU' => 'Amajyaruguru',
    'North' => 'Amajyaruguru',
    'North Province' => 'Amajyaruguru',
    'Northern Province' => 'Amajyaruguru',
    'UBURASIRAZUBA' => 'Iburasirazuba',
    'Kigali City' => 'Umujyi wa kigali',

Resolution - handled at dedicated script.

anvmn commented 1 month ago

Patients with empty district:

Selection_713

For KIVURUGA sector, district must be Gakenke. Setting manually.

Selection_715

For RUSHASHI sector, district must be Gakenke. Setting manually.

anvmn commented 1 month ago

Invalid District - 'Parent':

Resolution - single patient, handled when fixing Province.

anvmn commented 1 month ago

District - NYAMATA:

No such district. Province for all patients with this district is IBURASIRAZUBA.

Resolution - setting to only district of IBURASIRAZUBA province (BUGESERA). Handled at dedicated script.

anvmn commented 1 month ago

For sector, we have 67 distinct values, while one of them is empty and another 'Parent'.

In total, we support 66 unique sectors. Parent was handled already.

There's one patient with empty value:

For given province and sector, with village NGANWA we can resolve sector and cell:

Sector - Ntarama Cell - Kibungo

Resolution - update manually.

anvmn commented 1 month ago

152 patients that do not have cell field set:

144 handled at dedicated script. For remaining, opened https://github.com/Gizra/ihangane/issues/3154 and assigned to @Diama1 .

anvmn commented 3 weeks ago

Deployed to live