A test failed, I was promtoed for a reason but given no clue what test it was that failed.

Bug Description

Running this on a Z13 z/VM guest instance. I started a screen session and launched the server suite using the certify-ubuntu-server launcher.

I left it for a couple days or so and came back to find that something had failed, I was being prompted to provide a reason for the failure, but given no hint as to what test case actually failed. See below for console output info.

To resolve this, the error messaging should explicitly state WHAT test case failed that is a blocker... so rather than

This job is required in order to issue a certificate.

it should say

$JOB_ID is required in order to issue a certificate.

so the user knows which test failed.

Also as this is a fully automated test, I have no idea what failed or why, the failure happened sometime in the last week and I'm only now able to come back to the test to review it.

To Reproduce

This was on a z/13 instance, I do not know if it is reproducibe on a bare metal install, but maybe in a KVM instance?

Install noble on a KVM instance (or other VM?)
add PPA and install canonical-certification-server
start a screen session
run certify-ubuntu-server
if a blocker test fails (again, no clue currently what test failed) you'll be prompted to give an explanation but not given the test case name that failed.

Environment

Z13 z/VM, 24.04 as Ubuntu Guest Checkbox from the edge PPA

Relevant log output

When I returned to my screen session, this is all I was greeted wtih:

This job is required in order to issue a certificate.
Please add a comment to explain why it failed.
Please enter your comments:

As this was a screen session, there's no scrollback and no immeidate way to determine WHAT test is failed. I cancelled and restarted and this was the output I saw:

ubuntu@hwe0008:~$ certify-ubuntu-server
WARNING:plainbox.secure.providers.v1:Skipped file: /usr/share/checkbox-provider-base/units/camera/README.rst
WARNING:plainbox.secure.providers.v1:Skipped file: /usr/share/checkbox-provider-base/units/snapd/README.md
WARNING:plainbox.secure.providers.v1:Skipped file: /usr/share/checkbox-provider-base/units/stress/suspend_cycles_reboot.md
This job is required in order to issue a certificate.
Please add a comment to explain why it failed.
Please enter your comments:

So even after killing checkbox and restarting, there is no clue given as to what the actual test is that failed.



### Additional context

_No response_

canonical / checkbox