wazuh / wazuh

Wazuh - The Open Source Security Platform. Unified XDR and SIEM protection for endpoints and cloud workloads.
https://wazuh.com/
Other
9.34k stars 1.48k forks source link

Release 4.8.0 - RC 1 - API integration tests #23309

Closed RamosFe closed 1 week ago

RamosFe commented 1 week ago

The following issue aims to run all API integration tests for the current release candidate, report the results, and open new issues for any encountered errors.

API integration tests information

Main release candidate issue https://github.com/wazuh/wazuh/issues/23246
Version 4.8.0
Release candidate # 1
Tag v4.8.0-rc1
Previous API integration tests issue https://github.com/wazuh/wazuh/issues/23057

Test report procedure

All individual test checks must be marked as:
Pass The test ran successfully.
Xfail The test was expected to fail and it failed. It must be properly justified and reported in an issue.
Skip The test was not run. It must be properly justified and reported in an issue.
Fail The test failed. A new issue must be opened to evaluate and address the problem.
All test results must have one the following statuses:
:green_circle: All checks passed.
:red_circle: There is at least one failed check.
:yellow_circle: There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause. It must be included in the Fixes section of the current release candidate main issue.

Any expected fail or skipped test must have an issue justifying the reason. All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip or txt. This report can be used by the auditors to dig deeper into any possible failures and details.

Conclusions

All tests passed without any errors.

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted in order to close this issue.

RamosFe commented 1 week ago

Test report

ITResults.zip

Test results


Test name Pass XPass Skip XFail Fail Issues Ref. Status
test_active_response_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_agent_DELETE_endpoints.tavern.yaml 6 0 0 0 0 :green_circle:
test_agent_GET_endpoints.tavern.yaml 96 0 0 0 0 :green_circle:
test_agent_POST_endpoints.tavern.yaml 6 0 0 0 0 :green_circle:
test_agent_PUT_endpoints.tavern.yaml 10 0 0 0 0 :green_circle:
test_cdb_list_endpoints.tavern.yaml 5 0 0 0 0 :green_circle:
test_cluster_endpoints.tavern.yaml 49 0 0 0 0 :green_circle:
test_decoder_endpoints.tavern.yaml 25 0 0 0 0 :green_circle:
test_default_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_experimental_endpoints.tavern.yaml 12 0 0 0 0 :green_circle:
test_logtest_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_manager_endpoints.tavern.yaml 36 0 0 0 0 :green_circle:
test_mitre_endpoints.tavern.yaml 7 0 0 0 0 :green_circle:
test_overview_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rbac_black_active_response_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_rbac_black_agent_endpoints.tavern.yaml 42 0 0 0 0 :green_circle:
test_rbac_black_cdb_list_endpoints.tavern.yaml 5 0 0 0 0 :green_circle:
test_rbac_black_cluster_endpoints.tavern.yaml 19 0 0 0 0 :green_circle:
test_rbac_black_decoder_endpoints.tavern.yaml 6 0 0 0 0 :green_circle:
test_rbac_black_experimental_endpoints.tavern.yaml 12 0 0 0 0 :green_circle:
test_rbac_black_logtest_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_rbac_black_manager_endpoints.tavern.yaml 16 0 0 0 0 :green_circle:
test_rbac_black_mitre_endpoints.tavern.yaml 7 0 0 0 0 :green_circle:
test_rbac_black_overview_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rbac_black_rootcheck_endpoints.tavern.yaml 4 0 0 0 0 :green_circle:
test_rbac_black_rule_endpoints.tavern.yaml 8 0 0 0 0 :green_circle:
test_rbac_black_sca_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_rbac_black_security_endpoints.tavern.yaml 25 0 0 0 0 :green_circle:
test_rbac_black_syscheck_endpoints.tavern.yaml 4 0 0 0 0 :green_circle:
test_rbac_black_syscollector_endpoints.tavern.yaml 9 0 0 0 0 :green_circle:
test_rbac_black_task_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rbac_black_webhook_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rbac_white_active_response_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_rbac_white_agent_endpoints.tavern.yaml 42 0 0 0 0 :green_circle:
test_rbac_white_all_endpoints.tavern.yaml 163 0 0 0 0 :green_circle:
test_rbac_white_cdb_list_endpoints.tavern.yaml 5 0 0 0 0 :green_circle:
test_rbac_white_cluster_endpoints.tavern.yaml 19 0 0 0 0 :green_circle:
test_rbac_white_decoder_endpoints.tavern.yaml 6 0 0 0 0 :green_circle:
test_rbac_white_experimental_endpoints.tavern.yaml 12 0 0 0 0 :green_circle:
test_rbac_white_logtest_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_rbac_white_manager_endpoints.tavern.yaml 16 0 0 0 0 :green_circle:
test_rbac_white_mitre_endpoints.tavern.yaml 7 0 0 0 0 :green_circle:
test_rbac_white_overview_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rbac_white_rootcheck_endpoints.tavern.yaml 4 0 0 0 0 :green_circle:
test_rbac_white_rule_endpoints.tavern.yaml 8 0 0 0 0 :green_circle:
test_rbac_white_sca_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_rbac_white_security_endpoints.tavern.yaml 25 0 0 0 0 :green_circle:
test_rbac_white_syscheck_endpoints.tavern.yaml 4 0 0 0 0 :green_circle:
test_rbac_white_syscollector_endpoints.tavern.yaml 9 0 0 0 0 :green_circle:
test_rbac_white_task_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rbac_white_webhook_endpoints.tavern.yaml 1 0 0 0 0 :green_circle:
test_rootcheck_endpoints.tavern.yaml 4 0 0 0 0 :green_circle:
test_rule_endpoints.tavern.yaml 15 0 0 0 0 :green_circle:
test_sca_endpoints.tavern.yaml 45 0 0 0 0 :green_circle:
test_security_DELETE_endpoints.tavern.yaml 15 0 0 0 0 :green_circle:
test_security_GET_endpoints.tavern.yaml 11 0 0 0 0 :green_circle:
test_security_POST_endpoints.tavern.yaml 8 0 0 0 0 :green_circle:
test_security_PUT_endpoints.tavern.yaml 9 0 0 0 0 :green_circle:
test_syscheck_endpoints.tavern.yaml 34 0 0 0 0 :green_circle:
test_syscollector_endpoints.tavern.yaml 159 0 0 0 0 :green_circle:
test_task_endpoints.tavern.yaml 2 0 0 0 0 :green_circle:
test_webhook_endpoints.tavern.yaml 5 0 0 0 0 :green_circle:
juliamagan commented 1 week ago

LGTM