juliamagan
commented
1 week ago Test results
Reports
[manager_agent_env.zip](https://github.com/wazuh/wazuh/files/15245574/manager_agent_env.zip) [four_manager_disconnected_node_env.zip](https://github.com/wazuh/wazuh/files/15245575/four_manager_disconnected_node_env.zip) [enrollment_cluster_env.zip](https://github.com/wazuh/wazuh/files/15245576/enrollment_cluster_env.zip) [big_cluster_40_agents_env.zip](https://github.com/wazuh/wazuh/files/15245577/big_cluster_40_agents_env.zip) [basic_environment_env.zip](https://github.com/wazuh/wazuh/files/15245579/basic_environment_env.zip) [basic_cluster_env.zip](https://github.com/wazuh/wazuh/files/15245581/basic_cluster_env.zip) [agentless_cluster_env.zip](https://github.com/wazuh/wazuh/files/15245583/agentless_cluster_env.zip) [one_manager_agent_env.zip](https://github.com/wazuh/wazuh/files/15245572/one_manager_agent_env.zip)
| Test name | Status | Pass | XFail/Skip | Fail | Issues Ref. | |
| One Manager Agent | ||||||
| 1 | test_cluster/test_correct_merged_file_generation/test_correct_merged_file_generation.py | :green_circle: | 12 | 0 | 0 | |
| 2 | test_fim/test_files/test_files_cud.py | :green_circle: | 9 | 0 | 0 | |
| 3 | test_fim/test_synchronization/test_synchronization.py | :green_circle: | 6 | 0 | 0 | |
| Four Manager Disconnected Node | ||||||
| 4 | test_cluster/test_agent_groups/test_agent_groups_new_cluster_node.py | :green_circle: | 2 | 0 | 0 | |
| Agentless Cluster | ||||||
| 5 | test_cluster/test_integrity_sync/test_integrity_sync.py | :green_circle: | 4 | 0 | 0 | |
| 6 | test_cluster/test_ruleset_sync_status/test_ruleset_sync_status.py | :green_circle: | 1 | 0 | 0 | |
| 7 | test_jwt_invalidation/test_change_rbac_mode.py | :green_circle: | 4 | 0 | 0 | |
| 8 | test_jwt_invalidation/test_change_security_resources.py | :green_circle: | 4 | 0 | 0 | |
| 9 | test_jwt_invalidation/test_disconnected_nodes.py | :green_circle: | 1 | 0 | 0 | |
| 10 | test_jwt_invalidation/test_revoke_endpoint.py | :green_circle: | 6 | 0 | 0 | |
| 11 | test_jwt_invalidation/test_update_password.py | :green_circle: | 4 | 0 | 0 | |
| Enrollment Cluster | ||||||
| 12 | test_cluster/test_agent_enrollment/test_agent_enrollment.py | :green_circle: | 1 | 0 | ||
| 13 | test_cluster/test_agent_groups/test_agent_default_group_added.py | :green_circle: | 2 | 0 | 0 | |
| 14 | test_cluster/test_agent_groups/test_assign_agent_group_with_enrollment.py | :green_circle: | 1 | 0 | 0 | |
| 15 | test_cluster/test_agent_groups/test_assign_agent_never_connected_to_group.py | :green_circle: | 2 | 0 | 0 | |
| 16 | test_cluster/test_agent_groups/test_assign_agent_to_a_group_api.py | :green_circle: | 4 | 0 | 0 | |
| 17 | test_cluster/test_agent_groups/test_assign_agent_to_a_group_by_tool.py | :green_circle: | 2 | 0 | 0 | |
| 18 | test_cluster/test_agent_groups/test_assign_agent_to_a_group.py | :green_circle: | 4 | 0 | 0 | |
| 19 | test_cluster/test_agent_groups/test_assign_groups_guess.py | :green_circle: | 12 | 0 | 0 | |
| 20 | test_cluster/test_agent_groups/test_agent_groups.py | :green_circle: | 1 | 0 | 0 | |
| 21 | test_cluster/test_agent_groups/test_remove_group.py | :green_circle: | 10 | 0 | 0 | |
| 22 | test_cluster/test_agent_groups/test_group_sync_status.py | :green_circle: | 27 | 0 | 0 | |
| 23 | test_cluster/test_agent_groups/test_group_hash.py | :green_circle: | 8 | 0 | 0 | |
| Manager Agent | ||||||
| 24 | test_active_response_log_format/test_active_response_log_format.py | :green_circle: | 3 | 0 | 0 | |
| Basic Cluster | ||||||
| 25 | test_cluster/test_agent_info_sync/test_agent_info_sync.py | :green_circle: | 2 | 0 | 0 | |
| 26 | test_cluster/test_agent_key_polling/test_agent_key_polling.py | :green_circle: | 1 | 0 | 0 | |
| 27 | test_cluster/test_agent_files_deletion/test_agent_files_deletion.py | :green_circle: | 1 | 0 | 0 | |
| 28 | test_multigroups/test_multigroups.py | :green_circle: | 4 | 0 | 0 | |
| 29 | test_cluster/test_agent_groups/test_agent_groups_forced_change.py | :green_circle: | 3 | 0 | 0 | |
| Big Cluster 40 Agents | ||||||
| 30 | test_cluster/test_agent_groups/test_groups_sync_default.py | :green_circle: | 2 | 0 | 0 | |
| 31 | test_cluster/test_agent_groups/test_groups_sync_time.py | :green_circle: | 2 | 0 | 0 | |
| 32 | test_shutdown_message/test_shutdown_message.py | :yellow_circle: | 0 | 0 | 1 | https://github.com/wazuh/wazuh-qa/issues/5199 and https://github.com/wazuh/wazuh/issues/23221 |
| Basic Environment | ||||||
| 33 | test_agent_auth/test_agent_auth.py | :green_circle: | 20 | 0 | 0 | |
| 34 | test_enrollment/test_enrollment.py | :green_circle: | 20 | 0 | 0 |
MARCOSD4
The following issue aims to run all
system testsfor the current release candidate, report the results, and open new issues for any encountered errors.System tests information
Instructions
To run tests in an AWS EC2 virtual environment, the following requirements will need to be met:
These requirements should be requested to the @wazuh/devel-devops team via https://github.com/wazuh/internal-devel-requests.
For further information, check https://github.com/wazuh/wazuh-qa/tree/master/tests/system/README.md
Test report procedure
Any failing test must be properly addressed with a new issue, detailing the error and the possible cause. It must be included in the
Fixessection of the current release candidate main issue.Any expected fail or skipped test must have an issue justifying the reason. All auditors must validate the justification for an expected fail or skipped test.
An extended report of the test results must be attached as a zip or txt. This report can be used by the auditors to dig deeper into any possible failures and details.
Conclusion 🟡
Known issues
Auditors validation
The definition of done for this one is the validation of the conclusions and the test results from all auditors.
All checks from below must be accepted in order to close this issue.