[checkbox-ce-oem] Add timedatectl test in strict-confinement mode (New)

rickwu666666 commented 1 month ago

Description

Add timedatectl test for testing if timezone and NTP time sync can be configured in strict-confinement mode. This test rely on test snap.

Resolved issues

Documentation

Tests

Test result pass: https://certification.canonical.com/hardware/202304-31486/submission/368054/

Test result failed without connect interface: https://certification.canonical.com/hardware/202304-31486/submission/368057/

stanley31huang commented 1 month ago

I think we need to have post-suspend for timedate control tests as well.

Another point I would like to raise here is, is the interface connection will be connected automatically? If not, the confinement related tests will be skipped.

rickwu666666 commented 1 month ago

Another point I would like to raise here is, is the interface connection will be connected automatically? If not, the confinement related tests will be skipped.

No the interfaces connect won't be automatically. It's rely on manually or via a setup script. And yes, if the interfaces are not connected before the test, than the test will be skipped. And this is the reason which I put the requires of slot and plug.

rickwu666666 commented 1 month ago

list-bootstrapped of timedatectl: com.canonical.certification::connections com.canonical.certification::lsb com.canonical.certification::snap com.canonical.contrib::strict-confinement/timedatectl-timezone com.canonical.certification::rtc com.canonical.certification::sleep com.canonical.certification::suspend/suspend_advanced_auto com.canonical.contrib::after-suspend-strict-confinement/timedatectl-timezone com.canonical.contrib::strict-confinement/timedatectl-ntp com.canonical.contrib::after-suspend-strict-confinement/timedatectl-ntp

list-bootstrapped of mediacare: com.canonical.certification::lsb com.canonical.plainbox::manifest com.canonical.certification::snap com.canonical.contrib::strict-confine/mediacard/sdhc-insert com.canonical.certification::sleep com.canonical.certification::rtc com.canonical.certification::suspend/suspend_advanced_auto com.canonical.contrib::after-suspend-strict-confine/mediacard/sdhc-insert com.canonical.contrib::strict-confine/mediacard/sdhc-storage com.canonical.contrib::after-suspend-strict-confine/mediacard/sdhc-storage com.canonical.contrib::strict-confine/mediacard/sdhc-remove com.canonical.contrib::after-suspend-strict-confine/mediacard/sdhc-remove

rickwu666666 commented 1 month ago

@stanley31huang I've pushed the update to add post suspend parts. Thanks for the review.

stanley31huang commented 1 month ago

LGTM for now, but I would like to separate those jobs and test plans into following structure and also consistent naming rule.

root -> units -> test_plans.pxu
                    -> jobs.pxu

canonical / checkbox