search

canonical / checkbox

Checkbox
https://checkbox.readthedocs.io
GNU General Public License v3.0
30 stars 47 forks source link

The task firmware/fwts_desktop_diagnosis_results.log.gz fails to attach the logfile from firmware/fwts_desktop_diagnosis #501

Open djacobs98 opened 1 year ago

djacobs98 commented 1 year ago

Bug Description

com.cannoical.certification:firmware/fwts_desktop_diagnosis fails on ADL-S 202111-39654 with the RT-GA kernel.

However the I/O log only contains: Killed Killed Killed

com.cannonical.certification:firmware/fwts_desktop_diagnosis_results.log.gz claims to pass but the log file is not actually in the list of attachments.

As a result, the test fails and you have no idea why unless you run the test manually and parse the output yourself.

To Reproduce

Run with checkbox:

  1. sudo snap install checkbox22
  2. sudo snap install checkbox-iiotg-classic --classic --channel=latest/edge
  3. sudo su
  4. checkbox-iiotg-classic.shell
  5. checkbox-support-fwts_test --qa -l fwts.log

Environment

OS: IOTG Server + RT-GA Kernel Checkbox: checkbox22 + checkbox-iiotg-classic (--classic --channel=latest/edge) Test plan: Automated for Server, Firmware.

Relevant log output

The I/O log contains:
Killed
Killed
Killed

There is no logfile.

If you manually run the test, you will get a log file showing some tests pass, some tests fail (most failures are expected -- the DUT is using a development BIOS)

Additional context

No response

djacobs98 commented 1 year ago

It looks like one of the "Killed" is because the qa test set includes uefirtvariable.

This test is runs separately as well as part of the Desktop automated test set. If you run the test command against fwts manually and the EFI test driver is missing, this test will abort which Checkbox somehow interprets as "Killed." See GH510.