ICPI / DIV

Organizational Material
10 stars 2 forks source link

FY19Q4 Initial Panorama Testing Dates 11/19-11/20 COB #158

Closed KatieOC closed 4 years ago

KatieOC commented 4 years ago

Testing Timeline and Instructions

Timeline

Friday 11/15 - initial Q4 clean data entry closes in DATIM Tuesday 11/19 - Wednesday 11/20 QC Pano dashboards/dossiers in dev Friday, 11/22 - Pano Q4 release

Scope - Instruction

See PPT (does not include log in info) FY19Q4 Pre-Clean_Panorama_QC_Testing_no password.pptx

Testing Assignments/Dashboard PoCs

Testing Assignments/Dossier PoCs

PRIME Led Dossier QC

PQ Led Dossier QC

If a PoC is unavailable during the proposed testing time period, they are welcome to transfer testing responsibilities to another colleague by editing the above comment and assigning the new tester, and writing a new comment to inform test leads that a new assignment has been made.

reneerace commented 4 years ago

Index Testing: https://github.com/pepfar-datim/Analytics/issues/2251 Narratives: https://github.com/pepfar-datim/Analytics/issues/2549 Data Tables: https://github.com/pepfar-datim/Analytics/issues/2550 If needed, Financial Management: https://github.com/pepfar-datim/Analytics/issues/2541

kimisatoPC commented 4 years ago

@reneerace @KatieOC @HoustonJamie Confirming that GEND_GBV dashboards (Global, OU, Mech) will be retired at Q4 initial?

HoustonJamie commented 4 years ago

@kimisatoPC they will not be, the PSC did not approve this request, they will be retired at clean Q1

kimisatoPC commented 4 years ago

@HoustonJamie I don't see anyone assigned to QC them and I unfortunately don't have time.

HoustonJamie commented 4 years ago

@KatieOC @kimisatoPC we were aware of this and someone was assigned, Katie do you remember who?

kimisatoPC commented 4 years ago

@HoustonJamie @KatieOC I see that Parviez has been assigned. Sorry! I didn't look under PRIME section. We are all good.

KatieOC commented 4 years ago

@mahirnkhan @jleehurst @aliyahwakil @shazadahmed10 @randyyee @cnichols3h @mackenziecox1 @cnichols3h @HosseiniPR @anu87 @Yabayabadoo @vanamala-narasimhan @LaChandraS @BarbaraDdamulira @kkale25 @HoustonJamie how goes testing?? the day is half done! Will you finish? If you completed your QC and submitted tickets, please tick your box above. You can edit your section and say you submitted issues that still need to be resolved, if that's the case.

jleehurst commented 4 years ago

@mahirnkhan @jleehurst @aliyahwakil @shazadahmed10 @randyyee @cnichols3h @mackenziecox1 @cnichols3h @HosseiniPR @anu87 @Yabayabadoo @vanamala-narasimhan @LaChandraS @BarbaraDdamulira @kkale25 @HoustonJamie how goes testing?? the day is half done! Will you finish? If you completed your QC and submitted tickets, please tick your box above. You can edit your section and say you submitted issues that still need to be resolved, if that's the case.

@KatieOC @erinschelar We have done a lot of work on our dossier, but there are a number of issues. I will continue working, but I will need the morning. I can finish by noon tomorrow.

aliyahwakil commented 4 years ago

@KatieOC Yes, will be completed by today.

KatieOC commented 4 years ago

@kkale25 @shazadahmed10 @HoustonJamie @randyyee @Yabayabadoo how's it going?

kkale25 commented 4 years ago

@KatieOC - updated assigned dossiers!

Yabayabadoo commented 4 years ago

Dossier name: Viral Load: Global Chapter/Page: Facility Snapshot/Facility Counts OU: All Issue: Period selector contains quarters with no data. Remove FY18 Q1, Q2, Q3 image

Yabayabadoo commented 4 years ago

Dossier name: Viral Load: Global Chapter/Page: Viral Load Trends/ Pregnant & Breastfeeding Women VLC & VLS OU: All Issue: Page is missing Fiscal year selector image

randyyee commented 4 years ago

Dossier: Testing (Single OU) Chapter/Page: Index Testing Proxy Cascade > Peds Index proxy cascade trends & Chapter/Page: Index Testing Proxy Cascade > Adult index testing trends by sex

Issue: Yield y-axis not in percentage, as a result yield values not showing up on the graph.

@pilarbullis @janholcombe

image

image

randyyee commented 4 years ago

Dossier: Testing (Single OU) Chapter/Page: HTS_TST_POS > Pos: targets & results

Issue: Target value not lined up with Result values (left y-axis).

image

aliyahwakil commented 4 years ago

Prevention: Single OU -Botswana VMMC Chatper

Page: Age Results by Geographic Level Functionality Issue: Agency, SNU1, PSNU, IM/Partner filters not targeting both visuals

Page: Test Results by Geographic Level Functionality Issue: IM/Partner not targeting visual

Page: Technique by Geographic Level Functionality Issue: Agency, SNU1, PSNU, IM/Partner filters not targeting both visuals

Page: Followup by Geographic level Functionality Issue: Comparison selector not targeting visual

aliyahwakil commented 4 years ago

Prevention: Global VMMC Chapter

Page: Results and Targets Functionality Issue: Agency and IM/Partner filters not targeting Cumulative Results Year Comparison visual

Page: Global Trends Functionality Issue: Agency and IM/Partner filters not targeting both visuals

Page: Results by VMMC Priority Age Functionality Issue: Agency and IM/Partner filters not targeting VMMC Results by Priority Age visual

Page: Results by Testing Functionality Issue: Fiscal Year, Agency, IM/Partner not targeting VMMC Results by Testing visual

Page: Results by Technique Functionality Issue: Fiscal Year, Agency, IM/Partner not targeting VMMC Proportions by Technique

KatieOC commented 4 years ago

PMTCT-HEI dossier - no issues found.

erinschelar commented 4 years ago
1. OVC Global Dossier- ISSUE 1
2. OVC_SERV coarse age comparisons
3. OU-Eswatini
   4. Total achievement: Targets and % achievement do not match for Eswatini. Underlying data issue
erinschelar commented 4 years ago

image

erinschelar commented 4 years ago

image

erinschelar commented 4 years ago

image

erinschelar commented 4 years ago

image

kayla-z commented 4 years ago

Dossier/dashboard name: Cervical Cancer Global Chapter/page: Cervical Cancer Global Analysis - Cervical Cancer Results by OU Issue: When you select USAID, CXCA_SCRN_N, CXCA_SCRN_POS, and CXCA_TX_N data does not show up on table but shows up on the bar graph visual.

@shabeenally

11 25_1

kayla-z commented 4 years ago

Dossier/dashboard name: Cervical Cancer Global Chapter/page: Fine Age Results - Screening Results by Fine Age Issue: Can't select more than one quarter - no check boxes

@shabeenally

11 25_2

HoustonJamie commented 4 years ago

Dossier/dashboard name: Treatment Single OU Chapter/page: Treatment Overview/Treatment Summary Table Issue: Default for period still Q3 (did not get updated to be Q4)

HoustonJamie commented 4 years ago

Dossier/dashboard name: Treatment Single OU Chapter/page: NET_NEW and Treatment Cascade Issue: Order is supposed to be HTS_TST_POS, TX_NEW, TX_NET_NEW, not POS, TX_NET_NEW, and TX_NEW

kayla-z commented 4 years ago

Dossier/dashboard name: PrEP Chapter/page: PrEP Use Segmented by Population Group Issue: Can't select multiple quarters - no checkboxes

@shabeenally

HoustonJamie commented 4 years ago

Dossier/dashboard name: Treatment Single OU Chapter/page: Treatment Overview/Treatment Summary Issue: HTS_POS achievement should be 159% for Eswatini, and it 119% and TX_NET_NEW should be 12% and its 5%

image

image

[JH 11/26] Fixed. The visualization for HTS_TST_POS had hard coded Period = 2019 Q3. Replaced that with the following: image

TX_NET_NEW visualization filter was missing the Standardized disagg and a custom filter for the TX_NET_NEW target calculation to work. Here is the old viz filter: image

Here is what we did to fix it: image

HoustonJamie commented 4 years ago

Dossier/dashboard name: Treatment Single OU Chapter/page: Treatment Overview/Treatment Summary Issue: Retention Proxy 92% for Eswatini on Treatment Summary Dashboard and 90% for Treatment Summary @nmcarloni can you clarify which is accurate in the AM? Currently they are inconsistent but not sure which is correct

image

@HoustonJamie it should be 92%

HoustonJamie commented 4 years ago

Dossier/dashboard name: Treatment GLOBAL Chapter/page: Treatment Overview/Treatment Summary Issue: Same issues flagged in Single OU, TX_NET_NEW should be 31% achievement and is showing 2% achievement and HTS_POS achivement should be 94% but is 67%

image

image

[JH 11/26] Fixed. The visualization for HTS_TST_POS had hard coded Period = 2019 Q3, image Replaced that with the following: image

TX_NET_NEW visualization filter was missing the Standardized disagg and a custom filter for the TX_NET_NEW target calculation to work. Here is the old viz filter: image

Here is what we did to fix it: image

These are the values for Kenya: image

HoustonJamie commented 4 years ago

Dossier/dashboard name: Treatment Global Chapter/page: Treatment Overview/Treatment Summary Issue: Retention Proxy 93% for Kenya on Treatment Summary Dashboard and 94% for Treatment Summary @nmcarloni can you clarify which is accurate in the AM? Currently they are inconsistent but not sure which is correct

@HoustonJamie it should be 93%

image

petersonml commented 4 years ago

Dossier/dashboard name: TB Screening and TPT: Single OU Chapter/page: CH1: Page A-C, CH2: Pages A2, B, and C, CH3: Pages A, B2, and C2 OU: Kenya Issue: When selecting SNU1 and IM+Partner, the font size for the %TPT Completion table below does not adjust to accommodate for comparison level views. The data in the % TPT Completion table becomes impossible to see. Can we ensure that the font size will automatically be reduced when there are multiple ‘comparison attributes’ being presented (for ex. Kenya has 10+ SNU 1s). If it is not possible to ensure that the data can be legible when there are many attributes for a particular level comparison, then suggestion to remove IM+partner drill-down ability.

image

EAwong commented 4 years ago

Dossier/dashboard name: Clinical Cascade: Global, Clinical Cascade: OU and Clinical Cascade: Age/Sex Group Focus Chapter/page: Overall Cascade OU: All Issue: Numbers above result bars are cut off when small. It's okay if they are individually expanded.

EAwong commented 4 years ago

Dossier/dashboard name: Clinical Cascade: Global and Clinical Cascade: OU Chapter/page: Disaggregate Completeness OU: All Issue: No data for TX_NET_NEW - should it be blank? Consider removing if not going to show data?

Screen Shot 2019-11-25 at 8 02 41 PM
EAwong commented 4 years ago

Dossier/dashboard name: Clinical Cascade: Global Chapter/page: KP Testing & Yield OU: All Issue: Cumulative data for 2019 when selected all 4 quarters is lower than a single quarter (e.g., Zimbabwe 2019Q4 has 40,260 tested, but 2019Q1-4 has 29,935 tested.

@janholcombe (can't tag pilar for some reason)

I was able to identify that the data in the Global dossier does not match the MSD or clinical cascade single OU dossier

image

Jamie: Not sure if this is the same or a different issue, from this page had been flagged before https://github.com/pepfar-datim/Analytics/issues/2132#issuecomment-556442709

EAwong commented 4 years ago

Dossier/dashboard name: Clinical Cascade: Single OU Chapter/page: HTS: Modalities (Testing & Yield by Modality, Testing & Yield Modality and Age/Sex, Testing & Yield Trends by Age/Sex, and Testing & Yield Trends by Modality), HTS: Modalities & KP (Testing & Yield by modality & KP), HTS: KP (KP Testing & Yield) OU: All Issue: Can't or difficult to click on top row of filters or side column of filters

Screen Shot 2019-11-25 at 9 05 34 PM Screen Shot 2019-11-25 at 9 15 22 PM
erinschelar commented 4 years ago

OVC Global Dossier- ISSUE 5 Same issue across multiple pages, need IM and Agency filters All pages in Age/sex deep dive chapter Global results and OU results by program status OVC Trend data (also need SNU filter)

cnichols3h commented 4 years ago

Dossier/dashboard name: TB Screening and TPT: Single OU Chapter/page: CH2 D1 and CH2 D2. OU: Kenya Our html code does not work on these pages. For ex, one should be able to enter a # and that will return the appropriate # of listings/rankings.

cnichols3h commented 4 years ago

Dossier/dashboard name: TB Screening and TPT: Single OU Chapter/page: CH2 E. OU: Kenya For this visual, there is only data returned when the period “2019 Q2” is chosen. There is no data returned for any other periods. However, there should be data returned.

cnichols3h commented 4 years ago

Dossier/dashboard name: TB Screening and TPT: Single OU Chapter/page: ALL Chapters and Pages except CH 1 F and CH 2 F. OU: Kenya For the drop-down options under Period, targets and years appear. For ex., "2017 Target", "2018 Target", "2019 Target". However, these are not necessary as no data is returned for the visuals when choosing these Periods. Request to remove these options for all Chapters and Pages, except for CH 1 F and CH 2 F.

petersonml commented 4 years ago

Dossier/dashboard name: TB Screening and TPT: Single OU Chapter/page: CH1 Page G. OU: Kenya For this visual, the y-axis is hard-coded to 100% causing some data points (for ex. Kenya, OU level, FY18Q4) not to be shown. Request to adjust the upper limit to 105% in an effort to display these areas where poor data quality causes metrics >100%.

ERottinghaus commented 4 years ago

Dossier/dashboard name: Health Services: Single OU Chapter/page: OU Lab Quality OU: All Issue: Number of specimens received KPIs (all 7 boxes) are not changing when Implementing Mechanism + Partner selector is changed.

image

anu87 commented 4 years ago

Dossier: VL Single OU Chapter 2, Page: Testing Gap & VL Labs OU: Mozambique Issue: For some countries like Mozambique we can't see lab sites without zooming in on the map:

image

anu87 commented 4 years ago

Dossier: Viral Load Single OU Chapter 2, page: Specimen at Lab vs. Patients OU: All Issue: Note in red is redundant and needs to be removed

image

Yabayabadoo commented 4 years ago

Dossier: Health Services: Single OU Chapter: N/A OU: All Issue: Name of dossier is incorrect, Health Systems OR Health Systems Strengthening not Health Services image

Yabayabadoo commented 4 years ago

Dossier: Health Services: Single OU Chapter/Page: HRH Support Overview/HRH At a Glance- OU OU: All Issue: No Scroll bar for page, visual truncated image

Yabayabadoo commented 4 years ago

Dossier: Health Services: Single OU Chaper/Page: HRH Support Overview/HRH Coverage Comparison OU: South Africa Issue: No data displaying for any fiscal year

image

Yabayabadoo commented 4 years ago

Dossier: Health Services: Single OU Chapter/Page: HRH Support Overview/HRH Above Site comparison OU: SA Issue: Y axis generating odd intervals image

Yabayabadoo commented 4 years ago

Dossier: Health Services: Single OU Chapter /Page: HRH_CURR Cadre Mix/Average HRH team composition OU: South Africa Issue: left to right scrolling not working on this page. Visuals truncated

image