search

jac-uk / qt

Online testing tools
MIT License
0 stars 0 forks source link

Ensure expired tests are marked as 'completed' #23

Open andrew-isaac opened 1 year ago

andrew-isaac commented 1 year ago

Currently some tests are stuck 'in progress' until the end of the QT day when the 'Close & Score' function moves all 'in progress' tests to 'completed'.

Here we are considering the best way to move 'in progress' tests to 'completed' during the test day, as soon as they have expired.

This will ensure the candidate receives a confirmation email (see #19 )

warrensearle commented 1 year ago

The work in jac-uk/qt#22 will help to minimise how many candidates are stuck 'in progress'.

There are a few options for how we could automatically mark tests as completed however each has risks to consider:

  1. Schedule a task to run every 5 mins, say, which marks the stuck tests as 'completed'. This seems wasteful / could lead to inflated costs.
  2. Use Cloud Tasks / Cloud Queue / PubSub to check each task has completed successfully when it is due to expire. This could add a layer of complexity that is hard/expensive to manage.
  3. Include a manual button for SET to mark stuck tests as 'completed'. This would not necessarily be pressed regularly so candidates could still have a delay before receiving their 'completed email'.

It feels like the best course of action here may be no action! Let's see how much jac-uk/qt#22 helps reduce the problem.