CM4 secure boot - Githubissues

alexgg commented 7 months ago

Depends on https://github.com/balena-os/meta-balena/pull/3408

Contributor checklist

[x] Changes have been tested
- [x] Covered in automated test suite
- [ ] Manual test case recorded
[x] Change-type present on at least one commit
[x] Signed-off-by is present
[x] The PR complies with the Open Embedded Commit Patch Message Guidelines

Reviewer Guidelines

When submitting a review, please pick:
- 'Approve' if this change would be acceptable in the codebase (even if there are minor or cosmetic tweaks that could be improved).
- 'Request Changes' if this change would not be acceptable in our codebase (e.g. bugs, changes that will make development harder in future, security/performance issues, etc).
- 'Comment' if you don't feel you have enough information to decide either way (e.g. if you have major questions, or you don't understand the context of the change sufficiently to fully review yourself, but want to make a comment)

alexgg commented 6 months ago

@resin-jenkins retest this please

alexgg commented 6 months ago

qemu-genericx86-64-ext HUP failure:

jenkins-leviathan-v2-template-43425-worker-1  | dnsmasq-dhcp: DHCPACK(brx44k0xyb) 10.10.10.70 52:54:00:85:ee:d4 791fc76
jenkins-leviathan-v2-template-43425-client-1  | [2024-03-08T18:17:33.386Z][worker-hup]             not ok 1 - "hostapp-update -f /mnt/data/resin-data/image-isc697dr" failed. stderr: /etc/hostapp-update-hooks.d/1-bootfiles: line 21: /usr/libexec/os-helpers-sb: No such file or directory umount: /mnt/sysroot/inactive/balena/overlay2/e080a384a92c93263c2698209daba13fa68e9b68a901d11bbbfdf867236cfa39/merged: not mo

alexgg commented 6 months ago

Passed tests:

qemu-generic-amd64
qemu-generic-amd64-sb
qemu-genericx86-64-ext

alexgg commented 6 months ago

@resin-jenkins retest this please

alexgg commented 6 months ago

lgtm

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

qemu-generic-amd64-sb:

jenkins-leviathan-v2-template-45792-worker-1  | Enabling KVM hardware accelerated virtualization
jenkins-leviathan-v2-template-45792-worker-1  | QEMU args:
jenkins-leviathan-v2-template-45792-worker-1  |  [
jenkins-leviathan-v2-template-45792-worker-1  |   '-nographic',
jenkins-leviathan-v2-template-45792-worker-1  |   '-m',
jenkins-leviathan-v2-template-45792-worker-1  |   '4G',
jenkins-leviathan-v2-template-45792-worker-1  |   '-smp',
jenkins-leviathan-v2-template-45792-worker-1  |   '4',
jenkins-leviathan-v2-template-45792-worker-1  |   '-chardev',
jenkins-leviathan-v2-template-45792-worker-1  |   'pty,id=char0,logfile=/reports/dut-serial.txt,signal=off',
jenkins-leviathan-v2-template-45792-worker-1  |   '-serial',
jenkins-leviathan-v2-template-45792-worker-1  |   'chardev:char0',
jenkins-leviathan-v2-template-45792-worker-1  |   '--enable-kvm',
jenkins-leviathan-v2-template-45792-worker-1  |   '-nodefaults',
jenkins-leviathan-v2-template-45792-worker-1  |   '-drive',
jenkins-leviathan-v2-template-45792-worker-1  |   'format=raw,file=/data/externalDisk.img,if=none,id=ext0',
jenkins-leviathan-v2-template-45792-worker-1  |   '-device',
jenkins-leviathan-v2-template-45792-worker-1  |   'qemu-xhci',
jenkins-leviathan-v2-template-45792-worker-1  |   '-device',
jenkins-leviathan-v2-template-45792-worker-1  |   'usb-storage,drive=ext0',
jenkins-leviathan-v2-template-45792-worker-1  |   '-chardev',
jenkins-leviathan-v2-template-45792-worker-1  |   'socket,id=chrtpm,path=/var/tpm0/swtpm.sock',
jenkins-leviathan-v2-template-45792-worker-1  |   '-tpmdev',
jenkins-leviathan-v2-template-45792-worker-1  |   'emulator,id=tpm0,chardev=chrtpm',
jenkins-leviathan-v2-template-45792-worker-1  |   '-device',
jenkins-leviathan-v2-template-45792-worker-1  |   'tpm-tis,tpmdev=tpm0',
jenkins-leviathan-v2-template-45792-worker-1  |   '-M',
jenkins-leviathan-v2-template-45792-worker-1  |   'q35',
jenkins-leviathan-v2-template-45792-worker-1  |   '-cpu',
jenkins-leviathan-v2-template-45792-worker-1  |   'max',
jenkins-leviathan-v2-template-45792-worker-1  |   '-net',
jenkins-leviathan-v2-template-45792-worker-1  |   'nic,model=e1000,macaddr=52:54:00:61:2a:e9',
jenkins-leviathan-v2-template-45792-worker-1  |   '-net',
jenkins-leviathan-v2-template-45792-worker-1  |   'bridge,br=brpwjmlaz2',
jenkins-leviathan-v2-template-45792-worker-1  |   '-global',
jenkins-leviathan-v2-template-45792-worker-1  |   'driver=cfi.pflash01,property=secure,value=on',
jenkins-leviathan-v2-template-45792-worker-1  |   '-global',
jenkins-leviathan-v2-template-45792-worker-1  |   'ICH9-LPC.disable_s3=1',
jenkins-leviathan-v2-template-45792-worker-1  |   '-drive',
jenkins-leviathan-v2-template-45792-worker-1  |   'if=pflash,format=raw,unit=0,file=/usr/share/OVMF/OVMF_CODE.secboot.fd,readonly=on',
jenkins-leviathan-v2-template-45792-worker-1  |   '-drive',
jenkins-leviathan-v2-template-45792-worker-1  |   'if=pflash,format=raw,unit=1,file=/tmp/edk2-vars-pwjmlaz2.fd',
jenkins-leviathan-v2-template-45792-worker-1  |   '-qmp',
jenkins-leviathan-v2-template-45792-worker-1  |   'unix:/tmp/qmp.sock,server,wait=off',
jenkins-leviathan-v2-template-45792-worker-1  |   '-vnc',
jenkins-leviathan-v2-template-45792-worker-1  |   ':0'
jenkins-leviathan-v2-template-45792-worker-1  | ]
jenkins-leviathan-v2-template-45792-client-1  | [2024-04-04T18:38:15.413Z][worker-os] DUT powered on
jenkins-leviathan-v2-template-45792-client-1  | [2024-04-04T18:38:15.413Z][worker-os] GET http://worker/dut/ip
jenkins-leviathan-v2-template-45792-worker-1  | QEMU stdout: char device redirected to /dev/pts/0 (label char0)
jenkins-leviathan-v2-template-45792-worker-1  | 
jenkins-leviathan-v2-template-45792-client-1  | [2024-04-04T18:38:19.549Z][worker-os] connect EHOSTUNREACH 10.10.10.117:22222
jenkins-leviathan-v2-template-45792-client-1  | [2024-04-04T18:54:13.592Z][worker-os] connect EHOSTUNREACH 10.10.10.117:22222
jenkins-leviathan-v2-template-45792-client-1  | [2024-04-04T18:54:13.610Z][worker-os]             not ok 8 - Error: connect EHOSTUNREACH 10.10.10.117:22222
jenkins-leviathan-v2-template-45792-client-1  | [2024-04-04T18:54:13.610Z][worker-os]               ---
jenkins-leviatha

alexgg commented 5 months ago

I tested qemu-generic-amd64-sb locally and it does not fail in the same way as above.

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

@resin-jenkins retest this please

alexgg commented 5 months ago

qemu-generic-amd64-sb:

jenkins-leviathan-v2-template-46197-client-1  | *******  Final Test Result of Leviathan Run  *******
jenkins-leviathan-v2-template-46197-client-1  | [
jenkins-leviathan-v2-template-46197-client-1  |   {
jenkins-leviathan-v2-template-46197-client-1  |     suite: 'Managed BalenaOS release suite',
jenkins-leviathan-v2-template-46197-client-1  |     stats: { tests: 12, ran: 10, skipped: 2, passed: 10, failed: 0 },
jenkins-leviathan-v2-template-46197-client-1  |     tests: {
jenkins-leviathan-v2-template-46197-client-1  |       'Image preload test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Move device to hostapd test App': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Move device back to original app': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Provisioning without deltas': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Override lock test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Update supervisor randomized timer': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Set device environment variables': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Set service environment variables': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'SSH authentication in production mode': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'SSH authentication in development mode': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'os-config service on boot': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'os-config service randomized timer': 'passed'
jenkins-leviathan-v2-template-46197-client-1  |     },
jenkins-leviathan-v2-template-46197-client-1  |     dateTime: 'Thu Apr 11 2024 11:08:57 GMT+0000 (Coordinated Universal Time)'
jenkins-leviathan-v2-template-46197-client-1  |   },
jenkins-leviathan-v2-template-46197-client-1  |   {
jenkins-leviathan-v2-template-46197-client-1  |     suite: 'Hostapp update suite',
jenkins-leviathan-v2-template-46197-client-1  |     stats: { tests: 5, ran: 1, skipped: 4, passed: 0, failed: 1 },
jenkins-leviathan-v2-template-46197-client-1  |     tests: {
jenkins-leviathan-v2-template-46197-client-1  |       'Broken balena-engine': 'failed',
jenkins-leviathan-v2-template-46197-client-1  |       'Broken VPN': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Rollback altboot (broken init) test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'HUP from previous release': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'HUP from this release': 'skipped'
jenkins-leviathan-v2-template-46197-client-1  |     },
jenkins-leviathan-v2-template-46197-client-1  |     dateTime: 'Thu Apr 11 2024 11:37:25 GMT+0000 (Coordinated Universal Time)'
jenkins-leviathan-v2-template-46197-client-1  |   },
jenkins-leviathan-v2-template-46197-client-1  |   {
jenkins-leviathan-v2-template-46197-client-1  |     suite: 'Unmanaged BalenaOS release suite',
jenkins-leviathan-v2-template-46197-client-1  |     stats: { tests: 49, ran: 41, skipped: 8, passed: 41, failed: 0 },
jenkins-leviathan-v2-template-46197-client-1  |     tests: {
jenkins-leviathan-v2-template-46197-client-1  |       'check secure boot': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'BeagleBone Black u-boot overlay test: deactivate HDMI': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       '243390-rpi3 - CUS/EUS chipsets test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Kernel and device-tree overlap test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'fingerprint file test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'ext4 filesystems are checked on boot': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'OS-release file check': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Installer used migrator module': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'issue file check': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'issue.net file check': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Chronyd service': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Sync test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Source test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Offline sources test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'System time skew test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'kernel-overlap test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Bluetooth scanning test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Container healthcheck test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Container exposed variables test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Identification test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Cellular tests': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'hostname configuration test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'ntpServer test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'dnsServers test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'os.network.connectivity test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'os.network.wifi.randomMacAddressScan test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'udevRules test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'persistentLogging configuration test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Reboot test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Wired test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Wireless test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'Socks5 test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Http-connect test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Engine socket is exposed in development images': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Engine socket is not exposed in production images': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Engine watchdog recovery': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Engine healthcheck performance': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Under-voltage test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Ramdisks, zram and loop devices are not scanned for rootfs': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'by-state links are created': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'DToverlay & DTparam tests': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'state partition reset': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'data partition reset': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'RevPi Core 3 DIO module test': 'skipped',
jenkins-leviathan-v2-template-46197-client-1  |       'zram is enabled and configured as swap': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Internet sharing iptables rules test': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Respect application locks': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Reboot on application unlock': 'passed',
jenkins-leviathan-v2-template-46197-client-1  |       'Override update locks': 'passed'
jenkins-leviathan-v2-template-46197-client-1  |     },
jenkins-leviathan-v2-template-46197-client-1  |     dateTime: 'Thu Apr 11 2024 10:27:32 GMT+0000 (Coordinated Universal Time)'
jenkins-leviathan-v2-template-46197-client-1  |   }
jenkins-leviathan-v2-template-46197-client-1  | ]

The HUP broken balena engine failed with the device not being reachable after the reboot.

jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:07.999Z][worker-hup]             ok 2 - Should replace balena-engine with a null link to trigger rollback-health
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:07.999Z][worker-hup] Rebooting the DUT
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:08.000Z][worker-hup] GET http://worker/dut/ip
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:08.119Z][worker-hup] GET http://worker/dut/ip
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:11.214Z][worker-hup] No response from server
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:11.226Z][worker-hup] read ECONNRESET
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:12.217Z][worker-hup] connect ECONNREFUSED 10.10.10.162:22222
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:33.218Z][worker-hup] Timed out while waiting for handshake
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:20:53.218Z][worker-hup] Timed out while waiting for handshake
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:21:03.053Z][worker-hup] connect EHOSTUNREACH 10.10.10.162:22222
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.117Z][worker-hup] connect EHOSTUNREACH 10.10.10.162:22222
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.136Z][worker-hup]             not ok 3 - Error: connect EHOSTUNREACH 10.10.10.162:22222
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.136Z][worker-hup]               ---
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.137Z][worker-hup]               stack: |
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.137Z][worker-hup]                 retry.max_tries (lib/common/worker.js:371:13)
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.137Z][worker-hup]               at:
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]                 line: 371
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]                 column: 13
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]                 file: lib/common/worker.js
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]                 function: retry.max_tries
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]               test: Broken balena-engine
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]               source: |
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.138Z][worker-hup]                                      console.error(err.message);
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.139Z][worker-hup]                                      throw new Error(err);
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.139Z][worker-hup]                 ------------^
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.139Z][worker-hup]                                  }
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.139Z][worker-hup]               ...
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.155Z][worker-hup] 
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.156Z][worker-hup]             Bail out! Error: connect EHOSTUNREACH 10.10.10.162:22222
jenkins-leviathan-v2-template-46197-client-1  | [2024-04-11T11:37:11.168Z][worker-hup] Bail out! Error: connect EHOSTUNREACH 10.10.10.162:22222

alexgg commented 5 months ago

qemu-generic-aarch64:

jenkins-leviathan-v2-template-46198-client-1  | *******  Final Test Result of Leviathan Run  *******
jenkins-leviathan-v2-template-46198-client-1  | [
jenkins-leviathan-v2-template-46198-client-1  |   {
jenkins-leviathan-v2-template-46198-client-1  |     suite: 'Managed BalenaOS release suite',
jenkins-leviathan-v2-template-46198-client-1  |     stats: { tests: 12, ran: 0, skipped: 12, passed: 0, failed: 0 },
jenkins-leviathan-v2-template-46198-client-1  |     tests: {
jenkins-leviathan-v2-template-46198-client-1  |       'Image preload test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Move device to hostapd test App': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Move device back to original app': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Provisioning without deltas': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Override lock test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Update supervisor randomized timer': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Set device environment variables': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Set service environment variables': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'SSH authentication in production mode': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'SSH authentication in development mode': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'os-config service on boot': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'os-config service randomized timer': 'skipped'
jenkins-leviathan-v2-template-46198-client-1  |     },
jenkins-leviathan-v2-template-46198-client-1  |     dateTime: 'Thu Apr 11 2024 11:34:03 GMT+0000 (Coordinated Universal Time)'
jenkins-leviathan-v2-template-46198-client-1  |   },
jenkins-leviathan-v2-template-46198-client-1  |   {
jenkins-leviathan-v2-template-46198-client-1  |     suite: 'Hostapp update suite',
jenkins-leviathan-v2-template-46198-client-1  |     stats: { tests: 5, ran: 5, skipped: 0, passed: 5, failed: 0 },
jenkins-leviathan-v2-template-46198-client-1  |     tests: {
jenkins-leviathan-v2-template-46198-client-1  |       'Broken balena-engine': 'passed',
jenkins-leviathan-v2-template-46198-client-1  |       'Broken VPN': 'passed',
jenkins-leviathan-v2-template-46198-client-1  |       'Rollback altboot (broken init) test': 'passed',
jenkins-leviathan-v2-template-46198-client-1  |       'HUP from previous release': 'passed',
jenkins-leviathan-v2-template-46198-client-1  |       'HUP from this release': 'passed'
jenkins-leviathan-v2-template-46198-client-1  |     },
jenkins-leviathan-v2-template-46198-client-1  |     dateTime: 'Thu Apr 11 2024 12:34:07 GMT+0000 (Coordinated Universal Time)'
jenkins-leviathan-v2-template-46198-client-1  |   },
jenkins-leviathan-v2-template-46198-client-1  |   {
jenkins-leviathan-v2-template-46198-client-1  |     suite: 'Unmanaged BalenaOS release suite',
jenkins-leviathan-v2-template-46198-client-1  |     stats: { tests: 49, ran: 0, skipped: 49, passed: 0, failed: 0 },
jenkins-leviathan-v2-template-46198-client-1  |     tests: {
jenkins-leviathan-v2-template-46198-client-1  |       'check secure boot': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'BeagleBone Black u-boot overlay test: deactivate HDMI': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       '243390-rpi3 - CUS/EUS chipsets test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Kernel and device-tree overlap test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'fingerprint file test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'ext4 filesystems are checked on boot': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'OS-release file check': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Installer used migrator module': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'issue file check': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'issue.net file check': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Chronyd service': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Sync test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Source test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Offline sources test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'System time skew test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'kernel-overlap test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Bluetooth scanning test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Container healthcheck test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Container exposed variables test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Identification test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Cellular tests': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'hostname configuration test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'ntpServer test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'dnsServers test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'os.network.connectivity test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'os.network.wifi.randomMacAddressScan test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'udevRules test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'persistentLogging configuration test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Reboot test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Wired test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Wireless test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Socks5 test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Http-connect test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Engine socket is exposed in development images': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Engine socket is not exposed in production images': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Engine watchdog recovery': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Engine healthcheck performance': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Under-voltage test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Ramdisks, zram and loop devices are not scanned for rootfs': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'by-state links are created': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'DToverlay & DTparam tests': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'state partition reset': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'data partition reset': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'RevPi Core 3 DIO module test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'zram is enabled and configured as swap': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Internet sharing iptables rules test': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Respect application locks': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Reboot on application unlock': 'skipped',
jenkins-leviathan-v2-template-46198-client-1  |       'Override update locks': 'skipped'
jenkins-leviathan-v2-template-46198-client-1  |     },
jenkins-leviathan-v2-template-46198-client-1  |     dateTime: 'Thu Apr 11 2024 10:27:36 GMT+0000 (Coordinated Universal Time)'
jenkins-leviathan-v2-template-46198-client-1  |   }
jenkins-leviathan-v2-template-46198-client-1  | ]

The HUP suite passed, but the OS/cloud did not even start running with the device not reachable after setup.

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

Passed tests:

qemu-generic-amd64-sb
qemu-genericx86-64-ext

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

@resin-jenkins retest this please

alexgg commented 4 months ago

Passed local tests:

qemu-generic-amd64
qemu-generic-aarch64
qemu-generic-amd64-sb (except hup/rollbacks due to a known issue independent of this PR)

Passed tests:

qemu-generic-amd64
qemu-genericx86-64-ext
qemu-generic-aarch64

alexgg commented 4 months ago

Ran qemu-generic-amd64-sb locally disabling hup/rollbacks as there is currently a known issue that prevents this test from passing and is being worked on.

Manually merged.

balena-os / meta-balena

CM4 secure boot #3357

Contributor checklist

Reviewer Guidelines