canonical / checkbox

Checkbox is a testing framework used to validate device compatibility with Ubuntu Linux. It’s the testing tool developed for the purposes of the Ubuntu Certification program.
https://checkbox.readthedocs.io
GNU General Public License v3.0
34 stars 50 forks source link

It is not clear what `graphics/VESA_drivers_not_in_use` is testing, nor why it is failing #1471

Open boukeas opened 2 months ago

boukeas commented 2 months ago

Enhancement Proposal

There is no output when graphics/VESA_drivers_not_in_use fails, and it is therefore difficult to understand why it has failed. It is also unclear exactly what this test is supposed to check, the cases when it might fail and the severity of such a failure.

syncronize-issues-to-jira[bot] commented 2 months ago

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/CHECKBOX-1567.

This message was autogenerated

boukeas commented 2 months ago

I have changed the label to "bug". The commands that the test runs examines two Xorg log files to check that the VESA driver was unloaded as many times as it was loaded. The search is not restricted to the current session but is restricted to the latest log files (Xorg.0.log). So, the test could fail on a previous session and keep failing. The test could also fail when the log files are rotated.

I have confirmed that removing these two log files on a machine where the test fails and re-running the test is enough for the test to succeed.