MARCOSD4
commented
1 week ago Analysis Report
Graph Report 🔴
Manager
- **Disk:** Highly Decrease in `wazuh-modulesd` - **Disk_Read:** Decrease in `wazuh-modulesd` (similar to previous stages of 4.8.0). - **Disk_Written, Write_Ops:** Decrease in `wazuh-modulesd` - **FD:** increase in `wazuh-modulesd`: - New issue: https://github.com/wazuh/wazuh/issues/23202 - **PSS, RSS_MAXMIN, RSS, USS:** Increase in `wazuh-modulesd`: - New issue: https://github.com/wazuh/wazuh/issues/23304 - **VMS:** Increase in `wazuh-db` and `wazuh-remoted`. - **Read_ops:** increase in `wazuh-syscheckd`. Decrease in `wazuh-modulesd`. - **EDPS, Decoded_events:** decrease in edps and decoded from logcollector (similar to previous stages of 4.8.0).
CentOS
- **Disk:** increase in `wazuh-modulesd` - **Disk_Read:** small decrease in `wazuh-syschekd` - **Disk_written:** small increase in `wazuh-cmodulesd` - **Write_ops:** decrease in `wazuh-agentd` (similar to previous stages of 4.8.0). - **AgentD_Number_of_events_buffered:** The pattern is different (similar to previous stages of 4.8.0). - **AgentD_Number_of_messages:** decrease in number of messages.
Ubuntu
- **AgentD_Number_of_events_buffered:** The pattern is different (similar to previous stages of 4.8.0). - **AgentD_Number_of_messages:** decrease in number of messages.
Windows
- **AgentD_Number_of_events_buffered:** The pattern is different (similar to previous stages of 4.8.0). - **AgentD_Number_of_messages:** decrease in number of messages.
Log Report 🟡
Manager
- Expected in Stress Tests ```console 2024/05/05 00:01:03 wazuh-syscheckd WARNING: Real-time inotify kernel queue is full. Some events may be lost. Next scheduled scan will recover lost data. 2024/05/05 00:07:51 wazuh-logcollector WARNING: (1960): File limit has been reached (1000). Please reduce the number of files or increase "logcollector.max_files". 2024/05/04 04:27:25 wazuh-analysisd WARNING: Rootcheck decoder queue is full. 2024/05/03 15:18:07 wazuh-logcollector WARNING: Target 'agent' message queue is full (1024). Log lines may be lost. 2024/05/03 21:21:19 wazuh-analysisd WARNING: Input queue is full. 2024/05/03 21:21:32 wazuh-remoted WARNING: Message queue is full (10). Events may be lost. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4867 ```console 2024/05/03 15:19:07 wazuh-remoted WARNING: Agent key already in use: agent ID '002' ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/6368 ```console 2024/05/03 15:19:33 wazuh-modulesd:vulnerability-scanner WARNING: The 'feed-update-interval' option at module 'vulnerability-detection' must be at least 1 hour. Automatically set to 60 minutes. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4469 ```console 2024/05/03 15:19:32 wazuh-modulesd:ciscat WARNING: No evals defined. Exiting... ``` - Reported in https://github.com/wazuh/wazuh/issues/22565 ```console 2024/05/03 15:16:00 indexer-connector WARNING: No username and password found in the keystore, using default values. 2024/05/03 15:16:00 indexer-connector WARNING: IndexerConnector initialization failed for index 'wazuh-states-vulnerabilities', retrying until the connection is successful. 2024/05/03 15:17:12 indexer-connector WARNING: Failed to sync agent '000' with the indexer. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/5287 ```console 2024/05/05 01:45:49 wazuh-syscheckd WARNING: (6922): Cannot open '/tmp/syscheck_test/directories/dir381': No such file or directory ``` - Reported in https://github.com/wazuh/wazuh/issues/9311 ```console 2024/05/03 15:19:33 wazuh-modulesd:oscap ERROR: Internal error. Exiting... ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4481 ```console 2024/05/06 01:28:44 wazuh-modulesd:azure-logs ERROR: azure-activity: Returned error code: '1'. ```
Centos
- Expected in Stress Tests ```console 2024/05/06 00:37:45 wazuh-agentd WARNING: Agent buffer is full: Events may be lost. 2024/05/05 00:00:42 wazuh-syscheckd WARNING: Real-time inotify kernel queue is full. Some events may be lost. Next scheduled scan will recover lost data. 2024/05/05 00:07:53 wazuh-logcollector WARNING: (1960): File limit has been reached (1000). Please reduce the number of files or increase "logcollector.max_files". 2024/05/03 21:22:10 wazuh-logcollector WARNING: Target 'agent' message queue is full (1024). Log lines may be lost. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4867 ```console 2024/05/03 15:19:17 wazuh-agentd ERROR: (1137): Lost connection with manager. Setting lock. 2024/05/03 15:19:17 wazuh-agentd ERROR: (1216): Unable to connect to '[172.31.0.25]:1514/tcp': 'Connection refused'. 2024/05/03 15:19:17 wazuh-modulesd WARNING: Process locked due to agent is offline. Waiting for connection... ``` - Reported in https://github.com/wazuh/wazuh/issues/9311 ```console 2024/05/03 15:19:05 wazuh-modulesd:oscap ERROR: Internal error. Exiting... ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4469 ```console 2024/05/06 00:00:13 wazuh-modulesd:ciscat ERROR: Report result file 'tmp/ciscat-report.txt' missing: No such file or directory 2024/05/06 00:00:13 wazuh-modulesd:ciscat ERROR: Failed reading scan results for policy '/var/ossec/wodles/cis-cat/benchmarks/CIS_Google_Chrome_Benchmark_v1.2.0-xccdf.xml' ```
Windows
- Expected in Stress Tests ```console 2024/05/05 00:00:20 wazuh-agent WARNING: Agent buffer at 90 %. 2024/05/05 00:00:22 wazuh-agent WARNING: (6906): Real time process: no data. Probably buffer overflow. 2024/05/05 00:00:30 wazuh-agent WARNING: Agent buffer is full: Events may be lost. 2024/05/05 00:00:59 wazuh-agent WARNING: (1960): File limit has been reached (200). 2024/05/05 00:25:41 wazuh-modulesd:ciscat WARNING: Interval overtaken. 2024/05/03 21:21:10 wazuh-agent WARNING: Target 'agent' message queue is full (1024). Log lines may be lost. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/5287 ```console [2024-05-04_11:27:28] [ERROR] (create_delete): files\fimStress.5825111 file cannot be deleted. 2024/05/05 00:46:29 wazuh-agent WARNING: (6922): Cannot open 'c:\tmp\syscheck_test\directories\dir4524': No such file or directory ``` - Reported in https://github.com/wazuh/wazuh/issues/12074 ```console 2024/05/05 15:20:59 wazuh-agent ERROR: (6613): Real time Windows callback process: 'Access is denied.' (5). ``` - Reported in https://github.com/wazuh/wazuh/issues/18995 ```console 2024/05/05 10:34:55 wazuh-agent ERROR: (1103): Could not open file 'C:\tmp\logcollector_test\date-2024-05-05-148-675.log' due to [(2)-(No such file or directory)]. 2024/05/05 00:01:26 wazuh-agent WARNING: At get_user(c:\tmp\syscheck_test\files\fimstress.11008654): CreateFile(): The system cannot find the file specified. (2) 2024/05/05 00:01:26 wazuh-agent ERROR: (6716): Could not open handle for 'c:\tmp\syscheck_test\files\fimstress.11008654'. Error code: 2 ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4867 ```console 2024/05/03 15:19:28 wazuh-agent ERROR: (1216): Unable to connect to '[172.31.0.25]:1514/tcp': 'No connection could be made because the target machine actively refused it.'. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4469 ```console 2024/05/05 00:25:41 wazuh-modulesd:ciscat ERROR: Timeout expired executing 'C:\cis-cat\benchmarks\CIS_Microsoft_Windows_Server_2016_Benchmark_v1.0.0-xccdf.xml'. 2024/05/03 15:19:55 wazuh-modulesd:ciscat ERROR: Report result file 'tmp\ciscat-report.txt' missing: No such file or directory ```
Ubuntu
- Expected in Stress Tests ```console 2024/05/06 03:21:11 wazuh-agentd WARNING: Agent buffer is full: Events may be lost. 2024/05/05 00:01:03 wazuh-syscheckd WARNING: Real-time inotify kernel queue is full. Some events may be lost. Next scheduled scan will recover lost data. 2024/05/05 00:08:44 wazuh-logcollector WARNING: (1960): File limit has been reached (1000). Please reduce the number of files or increase "logcollector.max_files". 2024/05/03 21:21:26 wazuh-logcollector WARNING: Target 'agent' message queue is full (1024). Log lines may be lost. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/5287 ```console 2024/05/04 07:05:49 wazuh-syscheckd WARNING: (6922): Cannot open '/tmp/syscheck_test/directories/dir3801': No such file or directory ``` - Reported in https://github.com/wazuh/wazuh/issues/9311 ```console 2024/05/03 15:19:35 wazuh-modulesd:oscap ERROR: Internal error. Exiting... ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4867 ```console 2024/05/03 15:19:22 wazuh-agentd ERROR: (1216): Unable to connect to '[172.31.0.25]:1514/tcp': 'Connection refused'. ``` - Reported in https://github.com/wazuh/wazuh-jenkins/issues/4469 ```console 2024/05/03 15:19:05 wazuh-modulesd:ciscat ERROR: CIS-CAT tool not found at '/var/ossec/wodles/cis-cat'. ```
santipadilla
juliamagan
Footprint metrics information
Stress test documentation
Packages used
Repository:
packages-dev.wazuh.comPackage path:
pre-releasePackage revision:
1Jenkins build: https://ci.wazuh.info/job/Test_stress/5117/
Manager
+Plots
                  Logs and configuration
[ossec_Test_stress_B5117_manager_2024-05-06.zip](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_manager_centos/logs/ossec_Test_stress_B5117_manager_2024-05-06.zip)CSV
[monitor-manager-Test_stress_B5117_manager-pre-release.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_manager_centos/data/monitor-manager-Test_stress_B5117_manager-pre-release.csv) [Test_stress_B5117_manager_analysisd_events.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_manager_centos/data/Test_stress_B5117_manager_analysisd_events.csv) [Test_stress_B5117_manager_analysisd_state.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_manager_centos/data/Test_stress_B5117_manager_analysisd_state.csv) [Test_stress_B5117_manager_remoted_state.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_manager_centos/data/Test_stress_B5117_manager_remoted_state.csv)Centos agent
+Plots
                Logs and configuration
[ossec_Test_stress_B5117_centos_2024-05-06.zip](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_centos/logs/ossec_Test_stress_B5117_centos_2024-05-06.zip)CSV
[monitor-agent-Test_stress_B5117_centos-pre-release.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_centos/data/monitor-agent-Test_stress_B5117_centos-pre-release.csv) [Test_stress_B5117_centos_agentd_state.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_centos/data/Test_stress_B5117_centos_agentd_state.csv)Ubuntu agent
+Plots
                Logs and configuration
[ossec_Test_stress_B5117_ubuntu_2024-05-06.zip](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_ubuntu/logs/ossec_Test_stress_B5117_ubuntu_2024-05-06.zip)CSV
[monitor-agent-Test_stress_B5117_ubuntu-pre-release.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_ubuntu/data/monitor-agent-Test_stress_B5117_ubuntu-pre-release.csv) [Test_stress_B5117_ubuntu_agentd_state.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_ubuntu/data/Test_stress_B5117_ubuntu_agentd_state.csv)Windows agent
+Plots
              Logs and configuration
[ossec_Test_stress_B5117_windows_2024-05-06.zip](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_windows/logs/ossec_Test_stress_B5117_windows_2024-05-06.zip)CSV
[monitor-winagent-Test_stress_B5117_windows-pre-release.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_windows/data/monitor-winagent-Test_stress_B5117_windows-pre-release.csv) [Test_stress_B5117_windows_agentd_state.csv](https://ci.wazuh.com/data/Test_stress/pre-release/4.8.0/B5117-3600m/B5117_agent_windows/data/Test_stress_B5117_windows_agentd_state.csv)macOS agent
+Plots
Logs and configuration
CSV
Solaris agent
+Plots
Logs and configuration
CSV
Conclusion :red_circle:
Plots compared to https://github.com/wazuh/wazuh/issues/23171
Graphs :red_circle:
New issues:
Logs :yellow_circle:
Known issues: