medic / care-teams

For Product Management
0 stars 0 forks source link

contact_detail apdex: finalize results #76

Closed michaelkohn closed 2 months ago

michaelkohn commented 3 months ago

(baseline here)

latin-panda commented 2 months ago

Apdex result after changes Kenya Docs: 6648 Offline user - CHW Safaricom Neon Ray phone (2GB RAM) Automation test (generic settings file) - manually assisted scroll

Screenshot 2024-05-01 at 4 25 45 PM
Telemetry doc https://github.com/medic/care-teams/files/15175834/new-ke-ellen.copy.json

Observation: Due to the large number of documents, it takes some minutes to warm up (reindexing, etc.). However, after this initial period, the user experience is good.

P.D. I'm still trying to run the before changes because I remembered that Ben merged this work about fetching 500 Reports instead of 50, and this change makes an impact on performance. But I messed up the run and didn't have time to run it again.

latin-panda commented 2 months ago

Apdex results (with the 500 reports feature)

I ran the before and after under the same conditions.

Kenya Docs: 6648 Offline user - CHW (CHP) Safaricom Neon Ray phone (2GB RAM) Automation test (generic settings file)

Screenshot 2024-05-02 at 7 41 30 PM Screenshot 2024-05-02 at 7 54 12 PM
Telemetry doc https://github.com/medic/care-teams/files/15188628/old-ke-el-1.json
latin-panda commented 2 months ago

A comparison about the duration in miliseconds (min, max, sum)

CHW Area ![Screenshot 2024-05-02 at 8 09 43 PM](https://github.com/medic/care-teams/assets/66472237/b2b4e8da-c096-4c8c-b5c2-ab8c4c708c55) ![Screenshot 2024-05-02 at 8 11 49 PM](https://github.com/medic/care-teams/assets/66472237/9aceb05c-a7cc-46e6-8a24-6eed03d420b3)
Household ![Screenshot 2024-05-02 at 8 13 11 PM](https://github.com/medic/care-teams/assets/66472237/87617b4b-82ee-4938-9a3f-99cf678d9909) ![Screenshot 2024-05-02 at 8 13 54 PM](https://github.com/medic/care-teams/assets/66472237/3b1e2a86-5eae-434b-b48a-d97c7b31ca7f)
Patient ![Screenshot 2024-05-02 at 8 15 02 PM](https://github.com/medic/care-teams/assets/66472237/7f0fe0d0-46dd-47de-9528-e33b31c7914c) ![Screenshot 2024-05-02 at 8 21 17 PM](https://github.com/medic/care-teams/assets/66472237/9ee7534b-c246-4a42-bead-3896a464af8f)
latin-panda commented 2 months ago

@michaelkohn please find the standard location for these metrics here

michaelkohn commented 2 months ago

Nice work @latin-panda . I've reformatted the spreadsheet just a bit to make it easier to sort and filter, as I expect to add more data to the same spreadsheet in the future.

One question, are these the only two things we changed for this or were there others?

https://github.com/medic/cht-core/issues/8994 https://github.com/medic/cht-core/issues/9019

latin-panda commented 2 months ago

@michaelkohn correct, those are the only things we changed.