canonical / checkbox

Checkbox is a testing framework used to validate device compatibility with Ubuntu Linux. It’s the testing tool developed for the purposes of the Ubuntu Certification program.
https://checkbox.readthedocs.io
GNU General Public License v3.0
33 stars 50 forks source link

Add manifest entry for dangerous grade images (new) #1541

Closed pieqq closed 1 month ago

pieqq commented 1 month ago

Description

In our testing lab, we need to provision some devices with Ubuntu Core images that are set to use the 'dangerous' grade.

This will fail the image/model-grade test.

Add a new dangerous_grade_core_image manifest to decide whether or not we should be running this test.

It will be run by default (when there is no manifest entry, its value is set to 'False'), but by setting it to True, the test will be skipped.

image

Resolved issues

Fix #1479 Fix CHECKBOX-1572

Documentation

Tests

codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 47.76%. Comparing base (dd75a99) to head (29018e7). Report is 6 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #1541 +/- ## ========================================== + Coverage 47.75% 47.76% +0.01% ========================================== Files 370 370 Lines 39739 39750 +11 Branches 6719 6720 +1 ========================================== + Hits 18976 18987 +11 Misses 20048 20048 Partials 715 715 ``` | [Flag](https://app.codecov.io/gh/canonical/checkbox/pull/1541/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical) | Coverage Δ | | |---|---|---| | [provider-base](https://app.codecov.io/gh/canonical/checkbox/pull/1541/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical) | `24.71% <ø> (+0.05%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=canonical#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.