canonical / checkbox

Checkbox is a testing framework used to validate device compatibility with Ubuntu Linux. It’s the testing tool developed for the purposes of the Ubuntu Certification program.
https://checkbox.readthedocs.io
GNU General Public License v3.0
33 stars 49 forks source link

Add manifest gate for obex tests (bugfix) #1585

Closed Hook25 closed 17 hours ago

Hook25 commented 2 weeks ago

Description

The obex test was introduced with the only gate being the presence of the software to test it. This is problematic because the software will always be installed in the snap, but not all platforms support this extension. Additionally one needs the hardware to test this capability as well. For this reason we have decided to introduce a new manifest to gate the execution of this test because it is currently failing in sru (we had to manually exclude it) and in snap testing (where it is non-trivial to exclude).

This also removes the test from the exclusion list, this way once we have the hardware to do sru obex tests we just need to enable it via the manifest without changing the test plans

Resolved issues

Fixes: https://warthogs.atlassian.net/browse/CHECKBOX-1646

Documentation

N/A

Tests

N/A

WARNING: This modifies com.canonical.certification::sru-server

codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 48.00%. Comparing base (7b5dd02) to head (f48e850). Report is 27 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #1585 +/- ## ======================================= Coverage 48.00% 48.00% ======================================= Files 371 371 Lines 39833 39833 Branches 6730 6730 ======================================= Hits 19121 19121 Misses 19994 19994 Partials 718 718 ``` | [Flag](https://app.codecov.io/gh/canonical/checkbox/pull/1585/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical) | Coverage Δ | | |---|---|---| | [provider-base](https://app.codecov.io/gh/canonical/checkbox/pull/1585/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical) | `24.71% <ø> (ø)` | | | [provider-sru](https://app.codecov.io/gh/canonical/checkbox/pull/1585/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical) | `97.97% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


🚨 Try these New Features: