search

canonical / checkbox

Checkbox is a testing framework used to validate device compatibility with Ubuntu Linux. It’s the testing tool developed for the purposes of the Ubuntu Certification program.
https://checkbox.readthedocs.io
GNU General Public License v3.0
33 stars 49 forks source link

List of rejected jobs is empty when using `match` feature #1568

Closed pieqq closed 1 week ago

pieqq commented 3 weeks ago

Bug Description

match function does not store rejected jobs, leading to fake info stored in C3:

https://certification.canonical.com/hardware/202204-30172/submission/401202/

This link shows the the test plan was not modified, but only 5 tests have been run despite it being the com.canonical.certification::client-cert-desktop-24-04 test plan that contains much more.

This is because the launcher used to run this is the following:

[test plan]
unit = com.canonical.certification::client-cert-desktop-24-04
forced = yes

[test selection]
forced = yes
match = com.canonical.certification::camera/detect

[launcher]
stock_reports = text, certification, submission_files

To Reproduce

Environment

Any recent version of Checkbox

Relevant log output

No response

Additional context

No response

syncronize-issues-to-jira[bot] commented 3 weeks ago

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/CHECKBOX-1635.

This message was autogenerated

pieqq commented 3 weeks ago

This has to do with checkbox-ng/plainbox/impl/session/assistant.py as modified by the match feature in #1422.