search

canonical / checkbox

Checkbox
https://checkbox.readthedocs.io
GNU General Public License v3.0
30 stars 47 forks source link

[checkbox-ce-oem] Add more detail for ce-oem-mtd/chec-total-numbers (Bugfix) #1262

Closed LiaoU3 closed 4 months ago

LiaoU3 commented 4 months ago

Description

Add more details for the job, so it will be easy to debug.

Resolved issues

Add more details

Documentation

N/A

Tests

When not setting TOTAL_MTD_NUM

===========================[ Running Selected Jobs ]============================
==============[ Running job 1 / 1. Estimated time left: 0:00:05 ]===============
----------------[ Check the total MTD numbers for the platform ]----------------
ID: com.canonical.contrib::ce-oem-mtd/check-total-numbers
Category: com.canonical.contrib::mtd
... 8< -------------------------------------------------------------------------
TOTAL_MTD_NUM is not defined!
------------------------------------------------------------------------- >8 ---
Outcome: job failed
Finalizing session that hasn't been submitted anywhere: checkbox-run-2024-05-31T06.56.32
==================================[ Results ]===================================
 ☒ : Check the total MTD numbers for the platform

When setting the wrong TOTAL_MTD_NUM

===========================[ Running Selected Jobs ]============================
==============[ Running job 1 / 1. Estimated time left: 0:00:05 ]===============
----------------[ Check the total MTD numbers for the platform ]----------------
ID: com.canonical.contrib::ce-oem-mtd/check-total-numbers
Category: com.canonical.contrib::mtd
... 8< -------------------------------------------------------------------------
The number of MTD is incorrect!
Expected: 5
Actual: 17
------------------------------------------------------------------------- >8 ---
Outcome: job failed
Finalizing session that hasn't been submitted anywhere: checkbox-run-2024-05-31T07.02.07
==================================[ Results ]===================================
 ☒ : Check the total MTD numbers for the platform

When setting the right TOTAL_MTD_NUM

===========================[ Running Selected Jobs ]============================
==============[ Running job 1 / 1. Estimated time left: 0:00:05 ]===============
----------------[ Check the total MTD numbers for the platform ]----------------
ID: com.canonical.contrib::ce-oem-mtd/check-total-numbers
Category: com.canonical.contrib::mtd
... 8< -------------------------------------------------------------------------
The number of MTD is correct!
Expected: 17
Actual: 17
------------------------------------------------------------------------- >8 ---
Outcome: job passed
Finalizing session that hasn't been submitted anywhere: checkbox-run-2024-05-31T07.05.47
==================================[ Results ]===================================
 ☑ : Check the total MTD numbers for the platform