Improvements to QT Admin dashboard

[nickaddy]

Background

Whilst we are making updates to the QT candidate platform, it makes sense to also make some snappy improvements to the QT Admin dashboard to help provide more clarity to users, particularly in relation to the stats displayed.

User Story

As the Digital team, I would like the QT Admin dashboard to be clearer so that it is easy for Admins to understand the numbers.

Feature(s) Description

Answer the following questions:

• [ ] What are the possible states of a QT?
• CREATED: 'created', SUBMITTED: 'submitted-for-approval', APPROVED: 'approved', INITIALISED: 'initialised', ACTIVATED: 'activated', PAUSED: 'paused', STARTED: 'started', PROGRESS: 'in-progress', COMPLETED: 'completed',
• [ ] What is the difference between initialised and activated?
• initialised - The test has been created, submitted for approval and approved. But the "open tests" button has not been pressed. Meaning a link (from the qt-admin platform to the test on the qt platform) is present and a participant can use their email to log in. They will see the test appear in their list of tests, but it will not be a link. The only information available to the participant is the title of the test, the start date and time and a status, which will be "Not Started".
• activated - If not the test has been created, submitted for approval, approved and the "open tests" button has been pressed. If the tests start date is in the future then 'activated' will be the exact same as 'initialised' above. Meaning a link (from the qt-admin platform to the test on the qt platform) is present and a participant can use their email to log in. They will see the test appear in their list of tests, and it will be a link which takes them to the start page of the QT. Where candidates will be able to view the Important information and additional information sections, before starting the test.
• [ ] What is the difference between the Responses and Reasonable Adjustments buttons?
• responses will list all participants invited to take the QT.
• Reasonable adjustments should be showing all participants that have had a reasonable adjustment applied to their response.
• [ ] Are auto-submitted tests included in the completed figure?
• yes

Tasks

• [ ] Add tool-tips explaining the difference between initialised and activated states?
• [ ] Add tool-tip to Completed number stating that 'Completed includes Auto-submitted tests'
• [ ] Add tool-tip to Auto-submitted stating that 'Auto-submitted tests will not show as completed until Close and score is clicked.'
• [ ] Change text on Responses button to All responses
• [ ] Update the cloud function to correct the stats when a QT is closed and scored (which Warren created)

Acceptance Criteria

It's done when tool-tips have been added to clarify the numbers on the dashboard and the cloud function has been updated.

Definition of Done

• [ ] User stories/acceptance criteria met
• [ ] Internal reviews passed (feedback actioned)
• [ ] User testing passed
• [ ] Relevant technical documentation updated
• [ ] User guidance updated
• [ ] Deployed and merged without errors

User Testing Steps

• Log in to the QT platform
• Go to the dashboard of a test
• Roll over the numbers and observe the tool-tips

Feature Champion

Nick

[nickaddy]

Hey team! Please add your planning poker estimate with Zenhub @drieJAC @HalcyonJAC @tomlovesgithub @warrensearle

[tomlovesgithub]

Answer the following questions:

• [ ] What are the possible states of a QT?
• CREATED: 'created', SUBMITTED: 'submitted-for-approval', APPROVED: 'approved', INITIALISED: 'initialised', ACTIVATED: 'activated', PAUSED: 'paused', STARTED: 'started', PROGRESS: 'in-progress', COMPLETED: 'completed',
• [ ] What is the difference between initialised and activated?
• initialised - The test has been created, submitted for approval and approved. But the "open tests" button has not been pressed. Meaning a link (from the qt-admin platform to the test on the qt platform) is present and a participant can use their email to log in. They will see the test appear in their list of tests, but it will not be a link. The only information available to the participant is the title of the test, the start date and time and a status, which will be "Not Started".
• activated - If not the test has been created, submitted for approval, approved and the "open tests" button has been pressed. If the tests start date is in the future then 'activated' will be the exact same as 'initialised' above. Meaning a link (from the qt-admin platform to the test on the qt platform) is present and a participant can use their email to log in. They will see the test appear in their list of tests, and it will be a link which takes them to the start page of the QT. Where candidates will be able to view the Important information and additional information sections, before starting the test.
• [ ] What is the difference between the Responses and Reasonable Adjustments buttons?
• responses will list all participants invited to take the QT.
• Reasonable adjustments should be showing all participants that have had a reasonable adjustment applied to their response.
• [ ] Are auto-submitted tests included in the completed figure?
• yes

[nickaddy]

@tomlovesgithub If I understand correctly (the activated description reads a bit confusingly,) a test is initialised and then activated. Pressing the Open tests button, changes the state to activated and allows candidates to log in and take the test - only if the test window is open, is that correct?

Further questions:

• [ ] Is there any guidance to Admins on when they should click the Open tests button?
• [ ] In the context of the QT Admin dashboard, what is the benefit of displaying initialised and activated totals? Are they not going to be identical?