Apdex testing scripts executed on MoH Uganda configuration

michaelkohn commented 5 months ago

MoH Uganda : https://care-teams-moh-uganda.dev.medicmobile.org/

Update scripts to accommodate MoH Uganda config
Run scripts on a physical device while offline
All scripts should be executed 10 times per day across 5 days (manually advancing the days)
Confirm data is syncing to PostgreSQL for analysis

ralfudx commented 3 months ago

@michaelkohn I've started modifying and prepping the tests so we can run them on Monday

michaelkohn commented 3 months ago

Moving to next week's sprint. If you don't think this can be finished during the week of 1-April, please let me know first thing Monday.

ralfudx commented 2 months ago

Test execution for MoH-UG Config is now complete 🟢 @michaelkohn @latin-panda kindly have a look at the data when it completely syncs User - raphaelle Device - Samsung SM-G955U, Android 9.0, API level 28

Test Sequence:

Run test suite (5x10 tests) - 04/15 48 passing, 2 Failing Sync data - 04/16 All reports synced
Run test suite (5x10 tests) - 04/16 49 passing, 1 Failing Sync data - 04/17 All reports synced
Run test suite (5x10 tests) - 04/17 49 passing, 1 Failing Sync data - 04/18 All reports synced
Run test suite (5x10 tests) - 04/13 49 passing, 1 Failing Sync data - 04/14 All reports synced
Run test suite (5x10 tests) - 04/14 49 passing, 1 Failing Sync data - 04/15 All reports synced

For these tests we filled the Pregnancy Registration form

Tests executed

I can submit a report for a newly created person ✅
I can view a person within the household ✅
I can view the CHW's Area ✅
I can open the Tasks page and view a task ✅
I can open the Performance page and relaunch the app ✅

Tests NOT executed

I can open the Reports page and view a report 🔴
I can open the Messages page and view a message 🔴

These two tests where skipped for the entire test execution because UG config does not have the Reports tab & Messages tab

michaelkohn commented 2 months ago

The tests have been executed but not 100% validated. We are planning on upgrading the testing framework and will need to run everything again (validation scripts and evaluation scripts). As a result, I'm closing this issue.

medic / care-teams

Apdex testing scripts executed on MoH Uganda configuration #9

Evaluation output