Closed michaelkohn closed 8 months ago
Initial data analysis I made related to this work
We will run performance testing on the config we are familiar with, and covering 3 major regions:
The phone use by Kenya deployment:
CHW
userFor CHWs
We will run the automation tests using at least 1 user and simulate 5 days, each day running 10 times the suite.
As an offline user, access the application and do the following navigation for each contact type:
@michaelkohn I still have to do the 4 Detailed click-path for the scenario
, but you can have a look and let me know your thoughts
The Nepal data you see there is what I could see from Raphael's test in our test instance for that config. I haven't properly analyzed that full data (the other ticket works) because it wasn't syncing to Postgresql, so I added the questions marks.
Thanks @latin-panda, great start. I don't know what this will all look like when we get to the point of publishing it, but this is really useful in starting to shake out all the details 🙏🏼
I'd imagine we'll want to be able to have a snapshot of it saved with our tests so that it can be recreated even if we end up changing the config in the future
@michaelkohn Do you mean like the Apdex result so we can compare later?
@michaelkohn I have updated the info based on your comments. Do you think something is missing? If we are good, I will close the ticket as completed.
Togo Info will have to wait until next week when the tests are ready
I'd imagine we'll want to be able to have a snapshot of it saved with our tests so that it can be recreated even if we end up changing the config in the future
@michaelkohn Do you mean like the Apdex result so we can compare later?
Nope, i meant keeping a snapshot of the actual config from when the tests were executed... I wouldn't expect it to change in the short term, but I can imagine in the future we may need to change the config to either accommodate some cht-core change or an important change to a project's config.
Do you think something is missing?
I actually think we should remove this section since it is covered in https://github.com/medic/care-teams/issues/69.
Thinking about this some more, do you think it's useful to add details like "load a contacts list that has 100 hh's in it, select the 5th household"....
Nope, i meant keeping a snapshot of the actual config from when the tests were executed.
Yes, we have a snapshot of every config in the Fast UI folder.
I've applied the last feedback and closed this as complete.