search

wazuh / wazuh

Wazuh - The Open Source Security Platform. Unified XDR and SIEM protection for endpoints and cloud workloads.
https://wazuh.com/
Other
10.72k stars 1.65k forks source link

Release 4.8.0 - Beta 2 - Python unit tests #22152

Closed RamosFe closed 8 months ago

RamosFe commented 8 months ago

The following issue aims to run all python unit tests for the current release candidate, report the results, and open new issues for any encountered errors.

Python unit tests information
Main release candidate issue https://github.com/wazuh/wazuh/issues/22069
Version 4.8.0
Release candidate # Beta 2
Tag v4.8.0-beta2
Previous python unit tests issue https://github.com/wazuh/wazuh/issues/22022

Test report procedure

All individual test checks must be marked as:
Pass The test ran successfully.
Xfail The test was expected to fail and it failed. It must be properly justified and reported in an issue.
Skip The test was not run. It must be properly justified and reported in an issue.
Fail The test failed. A new issue must be opened to evaluate and address the problem.
All test results must have one the following statuses:
:green_circle: All checks passed.
:red_circle: There is at least one failed check.
:yellow_circle: There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause. It must be included in the Fixes section of the current release candidate main issue.

Any expected fail or skipped test must have an issue justifying the reason. All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip or txt. This report can be used by the auditors to dig deeper into any possible failures and details.

As for the coverage results, they must be added split by modules. Test files must not be included in the coverage report.

All test coverage results must have one of the following statuses:
:green_square: >= 75%
:yellow_square: >= 50%
:orange_square: >= 25%
:red_square: < 25%

Conclusions

All tests have passed and the fails have been reported or justified. I therefore conclude that this issue is finished and OK for this release candidate.

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted in order to close this issue.

RamosFe commented 8 months ago

Test report

4.8.0-beta2.tar.gz

Test results

API Test

Test name Pass XPass Skip XFail Fail Issues Ref. Status
controllers/test/test_active_response_controller.py 1 0 0 0 0 :green_circle:
controllers/test/test_agent_controller.py 44 0 0 0 0 :green_circle:
controllers/test/test_cdb_list_controller.py 6 0 0 0 0 :green_circle:
controllers/test/test_ciscat_controller.py 1 0 0 0 0 :green_circle:
controllers/test/test_cluster_controller.py 24 0 0 0 0 :green_circle:
controllers/test/test_decoder_controller.py 7 0 0 0 0 :green_circle:
controllers/test/test_default_controller.py 1 0 0 0 0 :green_circle:
controllers/test/test_event_controller.py 1 0 0 0 0 :green_circle:
controllers/test/test_experimental_controller.py 15 0 0 0 0 :green_circle:
controllers/test/test_manager_controller.py 21 0 0 0 0 :green_circle:
controllers/test/test_mitre_controller.py 7 0 0 0 0 :green_circle:
controllers/test/test_overview_controller.py 1 0 0 0 0 :green_circle:
controllers/test/test_rootcheck_controller.py 4 0 0 0 0 :green_circle:
controllers/test/test_rule_controller.py 8 0 0 0 0 :green_circle:
controllers/test/test_sca_controller.py 2 0 0 0 0 :green_circle:
controllers/test/test_security_controller.py 51 0 0 0 0 :green_circle:
controllers/test/test_syscheck_controller.py 4 0 0 0 0 :green_circle:
controllers/test/test_syscollector_controller.py 9 0 0 0 0 :green_circle:
controllers/test/test_task_controller.py 1 0 0 0 0 :green_circle:
models/test/test_model.py 30 0 0 0 0 :green_circle:
test/test_alogging.py 22 0 0 0 0 :green_circle:
test/test_authentication.py 11 0 0 0 0 :green_circle:
test/test_configuration.py 45 0 0 0 0 :green_circle:
test/test_encoder.py 3 0 0 0 0 :green_circle:
test/test_middlewares.py 15 0 0 0 0 :green_circle:
test/test_signals.py 9 0 0 0 0 :green_circle:
test/test_uri_parser.py 3 0 0 0 0 :green_circle:
test/test_util.py 47 0 0 0 0 :green_circle:
test/test_validator.py 176 0 0 0 0 :green_circle:

Framework Test

Test name Pass XPass Skip XFail Fail Issues Ref. Status
scripts/tests/test_agent_groups.py 14 0 0 0 0 :green_circle:
scripts/tests/test_agent_upgrade.py 15 0 0 0 0 :green_circle:
scripts/tests/test_cluster_control.py 6 0 0 0 0 :green_circle:
scripts/tests/test_rbac_control.py 9 0 0 0 0 :green_circle:
scripts/tests/test_wazuh_clusterd.py 7 0 0 0 0 :green_circle:
scripts/tests/test_wazuh_logtest.py 22 0 0 0 0 :green_circle:
wazuh/core/cluster/dapi/tests/test_dapi.py 32 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_client.py 16 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_cluster.py 35 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_common.py 84 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_control.py 6 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_local_client.py 14 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_local_server.py 24 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_master.py 47 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_server.py 29 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_utils.py 16 0 0 0 0 :green_circle:
wazuh/core/cluster/tests/test_worker.py 34 0 0 0 0 :green_circle:
wazuh/core/tests/test_active_response.py 20 0 0 0 0 :green_circle:
wazuh/core/tests/test_agent.py 149 0 0 0 0 :green_circle:
wazuh/core/tests/test_cdb_list.py 38 0 0 0 0 :green_circle:
wazuh/core/tests/test_common.py 9 0 0 0 0 :green_circle:
wazuh/core/tests/test_configuration.py 88 0 0 0 0 :green_circle:
wazuh/core/tests/test_database.py 13 0 0 0 0 :green_circle:
wazuh/core/tests/test_decoder.py 16 0 0 0 0 :green_circle:
wazuh/core/tests/test_exception.py 10 0 0 0 0 :green_circle:
wazuh/core/tests/test_input_validator.py 3 0 0 0 0 :green_circle:
wazuh/core/tests/test_logtest.py 2 0 0 0 0 :green_circle:
wazuh/core/tests/test_manager.py 31 0 0 0 0 :green_circle:
wazuh/core/tests/test_mitre.py 13 0 0 0 0 :green_circle:
wazuh/core/tests/test_pyDaemonModule.py 5 0 0 0 0 :green_circle:
wazuh/core/tests/test_results.py 40 0 0 0 0 :green_circle:
wazuh/core/tests/test_rootcheck.py 13 0 0 0 0 :green_circle:
wazuh/core/tests/test_rule.py 23 0 0 0 0 :green_circle:
wazuh/core/tests/test_sca.py 29 0 0 0 0 :green_circle:
wazuh/core/tests/test_security.py 13 0 0 0 0 :green_circle:
wazuh/core/tests/test_stats.py 17 0 0 0 0 :green_circle:
wazuh/core/tests/test_syscheck.py 7 0 0 0 0 :green_circle:
wazuh/core/tests/test_syscollector.py 3 0 0 0 0 :green_circle:
wazuh/core/tests/test_task.py 8 0 0 0 0 :green_circle:
wazuh/core/tests/test_utils.py 279 0 0 0 0 :green_circle:
wazuh/core/tests/test_wazuh_queue.py 23 0 0 0 0 :green_circle:
wazuh/core/tests/test_wazuh_socket.py 20 0 0 0 0 :green_circle:
wazuh/core/tests/test_wdb.py 31 0 0 0 0 :green_circle:
wazuh/core/tests/test_wlogging.py 12 0 0 0 0 :green_circle:
wazuh/rbac/tests/test_auth_context.py 2 0 0 0 0 :green_circle:
wazuh/rbac/tests/test_decorators.py 109 0 0 0 0 :green_circle:
wazuh/rbac/tests/test_default_configuration.py 55 0 0 0 0 :green_circle:
wazuh/rbac/tests/test_orm.py 62 0 0 0 0 :green_circle:
wazuh/rbac/tests/test_preprocessor.py 11 0 0 0 0 :green_circle:
wazuh/tests/test_active_response.py 12 0 0 0 0 :green_circle:
wazuh/tests/test_agent.py 122 0 0 0 0 :green_circle:
wazuh/tests/test_cdb_list.py 53 0 0 0 0 :green_circle:
wazuh/tests/test_ciscat.py 33 0 0 0 0 :green_circle:
wazuh/tests/test_cluster.py 10 0 0 0 0 :green_circle:
wazuh/tests/test_decoder.py 58 0 0 0 0 :green_circle:
wazuh/tests/test_event.py 4 0 0 0 0 :green_circle:
wazuh/tests/test_group.py 7 0 0 0 0 :green_circle:
wazuh/tests/test_logtest.py 6 0 0 0 0 :green_circle:
wazuh/tests/test_manager.py 36 0 0 0 0 :green_circle:
wazuh/tests/test_mitre.py 7 0 0 0 0 :green_circle:
wazuh/tests/test_rootcheck.py 50 0 0 0 0 :green_circle:
wazuh/tests/test_rule.py 74 0 0 0 0 :green_circle:
wazuh/tests/test_sca.py 11 0 0 0 0 :green_circle:
wazuh/tests/test_security.py 71 0 0 0 0 :green_circle:
wazuh/tests/test_stats.py 15 0 0 0 0 :green_circle:
wazuh/tests/test_syscheck.py 25 0 0 0 0 :green_circle:
wazuh/tests/test_syscollector.py 12 0 0 0 0 :green_circle:
wazuh/tests/test_task.py 28 0 0 0 0 :green_circle:

Wodles Test

Test name Pass XPass Skip XFail Fail Issues Ref. Status
aws/tests/test_aws_bucket.py 209 0 0 0 0 :green_circle:
aws/tests/test_aws_s3.py 20 0 0 0 0 :green_circle:
aws/tests/test_aws_service.py 4 0 0 0 0 :green_circle:
aws/tests/test_cloudtrail.py 2 0 0 0 0 :green_circle:
aws/tests/test_cloudwatchlogs.py 53 0 0 0 0 :green_circle:
aws/tests/test_config.py 78 0 0 0 0 :green_circle:
aws/tests/test_guardduty.py 17 0 0 0 0 :green_circle:
aws/tests/test_inspector.py 6 0 0 0 0 :green_circle:
aws/tests/test_load_balancers.py 12 0 0 0 0 :green_circle:
aws/tests/test_s3_log_handler.py 4 0 0 0 0 :green_circle:
aws/tests/test_server_access.py 33 0 0 0 0 :green_circle:
aws/tests/test_sqs_queue.py 7 0 0 0 0 :green_circle:
aws/tests/test_tools.py 31 0 0 0 0 :green_circle:
aws/tests/test_umbrella.py 6 0 0 0 0 :green_circle:
aws/tests/test_vpcflow.py 27 0 0 0 0 :green_circle:
aws/tests/test_waf.py 7 0 0 0 0 :green_circle:
aws/tests/test_wazuh_integration.py 102 0 0 0 0 :green_circle:
azure/tests/test_azure.py 117 0 0 0 0 :green_circle:
azure/tests/test_orm.py 31 0 0 0 0 :green_circle:
listener/tests/test_docker_listener.py 19 0 0 0 0 :green_circle:
gcloud/tests/test_bucket.py 33 0 0 0 0 :green_circle:
gcloud/tests/test_gcloud.py 9 0 0 0 0 :green_circle:
gcloud/tests/test_integration.py 8 0 0 0 0 :green_circle:
gcloud/tests/test_subscriber.py 14 0 0 0 0 :green_circle:
gcloud/tests/test_tools.py 8 0 0 0 0 :green_circle:

Integration Test

Test name Pass XPass Skip XFail Fail Issues Ref. Status
tests/test_maltiverse.py 46 0 0 0 0 :green_circle:
tests/test_pagerduty.py 10 0 0 0 0 :green_circle:
tests/test_shuffle.py 18 0 0 0 0 :green_circle:
tests/test_slack.py 10 0 0 0 0 :green_circle:
tests/test_virustotal.py 22 0 0 0 0 :green_circle:
RamosFe commented 8 months ago

FRAMEWORK
Name Stmts Miss Cover Status
framework/init.py 0 0 100% :green_square:
framework/scripts/init.py 0 0 100% :green_square:
framework/scripts/agent_groups.py 177 17 90% :green_square:
framework/scripts/agent_upgrade.py 115 9 92% :green_square:
framework/scripts/cluster_control.py 133 1 99% :green_square:
framework/scripts/rbac_control.py 64 10 84% :green_square:
framework/scripts/wazuh_clusterd.py 120 14 88% :green_square:
framework/setup.py 3 3 0% :red_square:
framework/wazuh/init.py 49 13 73% :yellow_square:
framework/wazuh/main.py 2 2 0% :red_square:
framework/wazuh/active_response.py 25 0 100% :green_square:
framework/wazuh/agent.py 514 6 99% :green_square:
framework/wazuh/cdb_list.py 77 2 97% :green_square:
framework/wazuh/ciscat.py 27 0 100% :green_square:
framework/wazuh/cluster.py 64 0 100% :green_square:
framework/wazuh/core/InputValidator.py 19 0 100% :green_square:
framework/wazuh/core/init.py 0 0 100% :green_square:
framework/wazuh/core/active_response.py 70 3 96% :green_square:
framework/wazuh/core/agent.py 504 30 94% :green_square:
framework/wazuh/core/cdb_list.py 106 2 98% :green_square:
framework/wazuh/core/cluster/init.py 5 0 100% :green_square:
framework/wazuh/core/cluster/client.py 162 9 94% :green_square:
framework/wazuh/core/cluster/cluster.py 286 3 99% :green_square:
framework/wazuh/core/cluster/common.py 688 13 98% :green_square:
framework/wazuh/core/cluster/control.py 63 0 100% :green_square:
framework/wazuh/core/cluster/dapi/init.py 0 0 100% :green_square:
framework/wazuh/core/cluster/dapi/dapi.py 385 27 93% :green_square:
framework/wazuh/core/cluster/local_client.py 114 5 96% :green_square:
framework/wazuh/core/cluster/local_server.py 152 1 99% :green_square:
framework/wazuh/core/cluster/master.py 417 5 99% :green_square:
framework/wazuh/core/cluster/server.py 199 4 98% :green_square:
framework/wazuh/core/cluster/utils.py 163 0 100% :green_square:
framework/wazuh/core/cluster/worker.py 329 12 96% :green_square:
framework/wazuh/core/common.py 126 2 98% :green_square:
framework/wazuh/core/configuration.py 485 7 99% :green_square:
framework/wazuh/core/database.py 55 5 91% :green_square:
framework/wazuh/core/decoder.py 52 0 100% :green_square:
framework/wazuh/core/exception.py 116 3 97% :green_square:
framework/wazuh/core/manager.py 153 12 92% :green_square:
framework/wazuh/core/mitre.py 257 13 95% :green_square:
framework/wazuh/core/pyDaemonModule.py 64 17 73% :yellow_square:
framework/wazuh/core/results.py 335 24 93% :green_square:
framework/wazuh/core/rootcheck.py 61 0 100% :green_square:
framework/wazuh/core/rule.py 133 0 100% :green_square:
framework/wazuh/core/sca.py 78 2 97% :green_square:
framework/wazuh/core/security.py 70 18 74% :yellow_square:
framework/wazuh/core/stats.py 125 1 99% :green_square:
framework/wazuh/core/syscheck.py 28 0 100% :green_square:
framework/wazuh/core/syscollector.py 38 0 100% :green_square:
framework/wazuh/core/task.py 37 0 100% :green_square:
framework/wazuh/core/utils.py 992 51 95% :green_square:
framework/wazuh/core/wazuh_queue.py 82 2 98% :green_square:
framework/wazuh/core/wazuh_socket.py 160 76 52% :yellow_square:
framework/wazuh/core/wdb.py 210 9 96% :green_square:
framework/wazuh/core/wlogging.py 98 3 97% :green_square:
framework/wazuh/decoder.py 153 2 99% :green_square:
framework/wazuh/event.py 18 0 100% :green_square:
framework/wazuh/manager.py 142 17 88% :green_square:
framework/wazuh/mitre.py 53 0 100% :green_square:
framework/wazuh/rbac/init.py 0 0 100% :green_square:
framework/wazuh/rbac/auth_context.py 197 37 81% :green_square:
framework/wazuh/rbac/decorators.py 232 63 73% :yellow_square:
framework/wazuh/rbac/orm.py 1295 319 75% :green_square:
framework/wazuh/rbac/preprocessor.py 73 22 70% :yellow_square:
framework/wazuh/rbac/utils.py 23 10 57% :yellow_square:
framework/wazuh/rootcheck.py 64 3 95% :green_square:
framework/wazuh/rule.py 169 2 99% :green_square:
framework/wazuh/sca.py 63 3 95% :green_square:
framework/wazuh/security.py 552 203 63% :yellow_square:
framework/wazuh/stats.py 118 7 94% :green_square:
framework/wazuh/syscheck.py 95 4 96% :green_square:
framework/wazuh/syscollector.py 35 8 77% :green_square:
framework/wazuh/task.py 19 0 100% :green_square:
TOTAL 12088 1136 91% :green_square:

API
Name Stmts Miss Cover Status
api/init.py 0 0 100% :green_square:
api/alogging.py 78 0 100% :green_square:
api/api_exception.py 12 0 100% :green_square:
api/authentication.py 109 7 94% :green_square:
api/configuration.py 89 4 96% :green_square:
api/constants.py 14 0 100% :green_square:
api/controllers/init.py 0 0 100% :green_square:
api/controllers/active_response_controller.py 15 0 100% :green_square:
api/controllers/agent_controller.py 252 5 98% :green_square:
api/controllers/cdb_list_controller.py 41 0 100% :green_square:
api/controllers/ciscat_controller.py 13 0 100% :green_square:
api/controllers/cluster_controller.py 163 0 100% :green_square:
api/controllers/decoder_controller.py 46 0 100% :green_square:
api/controllers/default_controller.py 16 0 100% :green_square:
api/controllers/event_controller.py 15 0 100% :green_square:
api/controllers/experimental_controller.py 109 0 100% :green_square:
api/controllers/manager_controller.py 120 0 100% :green_square:
api/controllers/mitre_controller.py 41 0 100% :green_square:
api/controllers/overview_controller.py 12 0 100% :green_square:
api/controllers/rootcheck_controller.py 27 0 100% :green_square:
api/controllers/rule_controller.py 58 0 100% :green_square:
api/controllers/sca_controller.py 20 0 100% :green_square:
api/controllers/security_controller.py 245 9 96% :green_square:
api/controllers/syscheck_controller.py 31 0 100% :green_square:
api/controllers/syscollector_controller.py 65 0 100% :green_square:
api/controllers/task_controller.py 13 0 100% :green_square:
api/encoder.py 24 1 96% :green_square:
api/middlewares.py 104 37 64% :yellow_square:
api/models/init.py 3 0 100% :green_square:
api/models/active_response_model.py 29 0 100% :green_square:
api/models/agent_added_model.py 72 0 100% :green_square:
api/models/agent_inserted_model.py 50 0 100% :green_square:
api/models/basemodel.py 104 0 100% :green_square:
api/models/basic_info_model.py 59 0 100% :green_square:
api/models/configuration_model.py 205 0 100% :green_square:
api/models/events_ingest_model.py 17 0 100% :green_square:
api/models/group_added_model.py 15 0 100% :green_square:
api/models/security_model.py 72 0 100% :green_square:
api/models/security_token_response_model.py 19 0 100% :green_square:
api/signals.py 51 1 98% :green_square:
api/uri_parser.py 29 0 100% :green_square:
api/util.py 152 4 97% :green_square:
api/validator.py 163 14 91% :green_square:
TOTAL 2772 82 97% :green_square:

WODLES
Name Stmts Miss Cover Status
wodles/init.py 0 0 100% :green_square:
wodles/aws/init.py 0 0 100% :green_square:
wodles/aws/aws_s3.py 94 18 81% :green_square:
wodles/aws/aws_tools.py 144 22 85% :green_square:
wodles/aws/buckets_s3/init.py 10 0 100% :green_square:
wodles/aws/buckets_s3/aws_bucket.py 426 17 96% :green_square:
wodles/aws/buckets_s3/cloudtrail.py 26 3 88% :green_square:
wodles/aws/buckets_s3/config.py 91 7 92% :green_square:
wodles/aws/buckets_s3/guardduty.py 64 1 98% :green_square:
wodles/aws/buckets_s3/load_balancers.py 69 0 100% :green_square:
wodles/aws/buckets_s3/server_access.py 136 13 90% :green_square:
wodles/aws/buckets_s3/umbrella.py 22 0 100% :green_square:
wodles/aws/buckets_s3/vpcflow.py 107 15 86% :green_square:
wodles/aws/buckets_s3/waf.py 38 0 100% :green_square:
wodles/aws/services/init.py 4 0 100% :green_square:
wodles/aws/services/aws_service.py 44 0 100% :green_square:
wodles/aws/services/cloudwatchlogs.py 189 6 97% :green_square:
wodles/aws/services/inspector.py 56 6 89% :green_square:
wodles/aws/subscribers/init.py 4 0 100% :green_square:
wodles/aws/subscribers/s3_log_handler.py 113 62 45% :orange_square:
wodles/aws/subscribers/sqs_message_processor.py 35 22 37% :orange_square:
wodles/aws/subscribers/sqs_queue.py 60 7 88% :green_square:
wodles/aws/wazuh_integration.py 248 22 91% :green_square:
wodles/azure/azure-logs.py 450 16 96% :green_square:
wodles/azure/orm.py 141 0 100% :green_square:
wodles/docker-listener/DockerListener.py 93 6 94% :green_square:
wodles/gcloud/buckets/access_logs.py 16 0 100% :green_square:
wodles/gcloud/buckets/bucket.py 128 2 98% :green_square:
wodles/gcloud/exceptions.py 23 0 100% :green_square:
wodles/gcloud/gcloud.py 68 1 99% :green_square:
wodles/gcloud/integration.py 38 2 95% :green_square:
wodles/gcloud/pubsub/subscriber.py 60 2 97% :green_square:
wodles/gcloud/tools.py 41 0 100% :green_square:
wodles/utils.py 57 27 53% :yellow_square:
TOTAL 3095 277 91% :green_square:

INTEGRATIONS
Name Stmts Miss Cover Status
integrations/maltiverse.py 178 15 92% :green_square:
integrations/pagerduty.py 104 21 80% :green_square:
integrations/shuffle.py 105 7 93% :green_square:
integrations/slack.py 112 30 73% :yellow_square:
integrations/virustotal.py 174 45 74% :yellow_square:
TOTAL 673 118 82% :green_square:

OVERALL COVERAGE PERCENTAGE: 92%

damarisg commented 8 months ago

LGTM!