search

medic / care-teams

For Product Management
0 stars 0 forks source link

Apdex testing scripts executed on NSSD configuration #37

Closed michaelkohn closed 5 months ago

michaelkohn commented 7 months ago

NSSD : https://care-teams-nssd.dev.medicmobile.org/

michaelkohn commented 6 months ago

This instance is ready to go with data loaded. Removing the "Blocked" status.

https://medic.slack.com/archives/C02GME3BQE6/p1710912896801259

ralfudx commented 6 months ago

Test execution for NSSD Config is now complete 🟢 @michaelkohn @latin-panda kindly have a look at the data when it completely syncs to the Postgres User - kayley Device - Samsung SM-G955U, Android 9.0, API level 28

Test Sequence: Run test suite (7x10 tests) - 28/03 67 passing, 3 Failing Sync data - 29/03 All reports synced Run test suite (7x10 tests) - 29/03 70 passing Sync data - 30/03 All reports synced Run test suite (7x10 tests) - 30/03 70 passing Sync data - 31/03 All reports synced Run test suite (7x10 tests) - 27/03 70 passing Sync data - 28/03 All reports synced

With the addition of the should submit a report for a newly created person test which includes creating a task, each test now takes ~4mins to complete (which means the suite of tests for one day takes between 35-40mins to complete)

latin-panda commented 6 months ago

Thanks @ralfudx! I'm going to check it and post the results on Monday in this ticket

I'm going to query the data from 28th March to 31st March. Let me know if the date range is different than this.

michaelkohn commented 6 months ago

Moving to next week's sprint.

latin-panda commented 6 months ago

It's going to take me longer to verify, the DBs aren't syncing, I have asked Yuvraj in the team channel

latin-panda commented 6 months ago

I've run the scripts and posted the results in this ticket

latin-panda commented 6 months ago

@ralfudx I couldn't find where you fill-up the reports and tasks. Have you uploaded the latest code? I was looking for the form names to cross-check with what I see in the DB.

michaelkohn commented 5 months ago

The tests have been executed but not 100% validated. We are planning on upgrading the testing framework and will need to run everything again (validation scripts and evaluation scripts). As a result, I'm closing this issue.

Evaluation output

Image