[Feature]: Add Automated Settings testing

[mikeytdisco]

Feature Overview

Dfci supports Intune settings, and any device setting with a Dfci Settings Provider. Even within Intune settings, different platforms will implement different subsets of settings.

This feature will obtain the current settings from the system, and tailor the test case to verify that all of the implemented settings are tested.

Solution Overview

Prior to running the tests, the All Settings testcase will inspect the DfciTests.ini file for a list of settings to exclude for various reasons (known implementation error, etc). Then the available settings are randomly assigned to three groups, and the three settings apply packets, a restore settings packet, and a script of what packets are to be applied are staged to the host. The settings tests are run by the device under test, and after the settings are restored, the results are obtained by the All Settings testcase.

By staging the settings and restore packets on the device under test, disabling the Network interface for a boot will not be flagged as an error by the All Settings testcase.

Alternatives Considered

Manually supplying the settings for each test case run is untenable.

Urgency

Medium

Are you going to implement the feature request?

I will implement the feature

Do you need maintainer feedback?

No maintainer feedback needed

Anything else?

No response

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had activity in 45 days. It will be closed if no further activity occurs within 7 days. Thank you for your contributions.

[github-actions[bot]]

This issue has been automatically been closed because it did not have any activity in 45 days and no follow up within 7 days after being marked stale. Thank you for your contributions.