wazuh / wazuh-dashboard-plugins

Plugins for Wazuh Dashboard
https://wazuh.com/
GNU General Public License v2.0
437 stars 182 forks source link

Release 4.9.0 - Alpha 3 - Wazuh UI regression testing #6860

Closed Machi3mfl closed 4 months ago

Machi3mfl commented 4 months ago

The following issue aims to run manual tests for the current release candidate, report the results, and open new issues for any encountered errors.

Wazuh UI tests information

Main release candidate issue https://github.com/wazuh/wazuh/issues/24714
Version 4.9.0
Release candidate # Alpha 3
Tag v4.9.0-alpha3
Previous UI regression tests issue #6824

Test report procedure

TL;DR

  1. The specified tests will be executed in every platform and version mentioned in this issue.
  2. Include evidence of each test performed.
  3. Report any problem or bug. Open a new issue for each of them and link them here.
  4. Justify skipped tests.
All test results must have one the following statuses:
:black_circle: The test hasn't started yet.
:green_circle: All checks passed.
:red_circle: There is at least one failed check.
:yellow_circle: There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause. It must be included in the Problems section of the current release candidate issue.

Any expected fail or skipped test must be justified with a reason. All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip, txt or images. This report can be used by the auditors to dig deeper into any possible failures and details.

Test template

Test Chrome Firefox Safari
- :black_circle: :black_circle: :black_circle:

Test plan

  1. Verify the app package installs and operates as expected.
  2. Upgrade agents and edit their groups https://github.com/wazuh/wazuh-dashboard-plugins/issues/6138 https://github.com/wazuh/wazuh-dashboard-plugins/issues/6253
  3. Filter outdated agents
  4. Added macOS log collector tab to the agent configuration
  5. Added journald log collector tab to the agent configuration
  6. Changed agent log collector socket API response controller component
  7. Refactoring and redesign endpoints summary visualizations
  8. Added propagation of updates from the table to dashboard visualizations in Endpoints summary
  9. Replaced all Discover legacy implementations in favor of a custom discover view
  10. New filter handling system
  11. Refactored the search bar to correctly handle fixed and user-added filters
  12. Generate URL with predefined filters
  13. Added HAProxy helper settings to cluster configuration
  14. Disable the configuration editing with a wazuh.yml setting
  15. Enhance the validation for enrollment.dns on App Settings application
  16. Added ability to open the report file or Reporting application from the toast message
  17. Fixed an error of malformed table row on the generation of PDF reports
  18. Changed the usage of the endpoint GET /groups/{group_id}/files/{file_name}
  19. Change the view of API is down and check connection to Server APIs application
  20. Refactored AngularJS controllers to React
  21. Upgraded versions of follow-redirects and es5-ext
  22. Removed installation date information
  23. Moved the registry data to in-memory cache Removed API endpoint PUT /api/update-hostname/{id} Removed API endpoint GET /api/timestamp Removed API endpoint DELETE /hosts/remove-orphan-entries
  24. Added support for agents to Office 365
  25. Remove some branding references across the application
  26. Improve margins and paddings in the Events, Inventory and Control tabs
  27. Fix refreshing index pattern fields does not include the scripted fields
  28. Fixed the sample alerts scripts to generate valid IP ranges and file hashes
  29. Fixed cronjob max seconds interval validation
  30. Fixed styles in small height viewports
  31. Fixed behavior in Configuration Assessment when changing API
  32. Removed custom EuiSuggestItem component in favor of OUI's native component
  33. Removed legacy discover references and methods

Test

Test Chrome Firefox Safari
Verify the app package installs and operates as expected 🟑 :white_circle: :white_circle:
Upgrade agents and edit their groups 🟒 :white_circle: :white_circle:
Filter outdated agents 🟒 :white_circle: :white_circle:
Added macOS log collector tab to the agent configuration 🟒 :white_circle: 🟒
Added journald log collector tab to the agent configuration 🟒 :white_circle: :white_circle:
Changed agent log collector socket API response controller component 🟒 :white_circle: :white_circle:
Refactoring and redesign endpoints summary visualizations 🟒 :white_circle: 🟒
Added propagation of updates from the table to dashboard visualizations in Endpoints summary 🟒 :white_circle: :white_circle:
Replaced all Discover legacy implementations in favor of a custom discover view 🟒 :white_circle: 🟒
New filter handling system 🟒 :white_circle: 🟒
Refactored the search bar to correctly handle fixed and user-added filters 🟒 :white_circle: 🟒
Generate URL with predefined filters 🟒 :white_circle: 🟒
Added HAProxy helper settings to cluster configuration 🟒 :white_circle: :white_circle:
Disable the configuration editing with a wazuh.yml setting 🟒 :white_circle: :white_circle:
Enhance the validation for enrollment.dns on App Settings application 🟒 :white_circle: :white_circle:
Added ability to open the report file or Reporting application from the toast message 🟒 :white_circle: 🟒
Fixed an error of malformed table row on the generation of PDF reports πŸ”΄ :white_circle: :white_circle:
Changed the usage of the endpoint GET /groups/{group_id}/files/{file_name} 🟒 :white_circle: :white_circle:
Change the view of API is down and check connection to Server APIs application 🟒 :white_circle: :white_circle:
Refactored AngularJS controllers to React 🟒 :white_circle: :white_circle:
Upgraded versions of follow-redirects and es5-ext 🟒 :white_circle: :white_circle:
Removed installation date information 🟒 :white_circle: :white_circle:
Moved the registry data to in-memory cache 🟒 :white_circle: :white_circle:
Added support for agents to Office 365 🟒 :white_circle: 🟒
Remove some branding references across the application 🟒 :white_circle: :white_circle:
Improve margins and paddings in the Events, Inventory and Control tabs 🟒 :white_circle: :white_circle:
Fix refreshing index pattern fields does not include the scripted fields 🟒 :white_circle: :white_circle:
Fixed the sample alerts scripts to generate valid IP ranges and file hashes 🟒 :white_circle: :white_circle:
Fixed cronjob max seconds interval validation 🟒 :white_circle: :white_circle:
Fixed styles in small height viewports πŸ”΄ :white_circle: :white_circle:
Fixed behavior in Configuration Assessment when changing API 🟒 :white_circle: :white_circle:
Removed custom EuiSuggestItem component in favor of OUI's native component 🟒 :white_circle: :white_circle:
Removed legacy discover references and methods 🟒 :white_circle: :white_circle:

Conclusions πŸ”΄

All tests have been executed and the results can be above. The evidence is in the issue comment: https://github.com/wazuh/wazuh-dashboard-plugins/issues/6860#issuecomment-2247894258

We found two new bugs testing the following cases:

The βšͺ means that it is not necessary to do the test cross-browser because the change is not reflected on the UI

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted in order to close this issue.

Machi3mfl commented 4 months ago

Status 23/07/2024

Installing wazuh in VM provided by dev-ops team

Screenshot 2024-07-23 at 15 45 20

Installed running password changes mentioned here: https://github.com/wazuh/wazuh/issues/24847#issuecomment-2245299658

Screenshot 2024-07-23 at 16 25 38

Dashboard is running but is not connected with the Wazuh Server API

Screenshot 2024-07-23 at 16 48 05

I tried, changing the IP and using curl to connect directly with the API but return invalid credentials error

Screenshot 2024-07-23 at 16 47 26

Β Solved changing wazuh-ui password in wazuh.yml file

Method applied: https://github.com/wazuh/wazuh-dashboard-plugins/issues/6862#issuecomment-2245150920

Screenshot 2024-07-24 at 10 10 16

Installing wazuh agent in VM provided by dev-ops team

Screenshot 2024-07-24 at 10 09 11

Screenshot 2024-07-24 at 10 09 45
Machi3mfl commented 4 months ago

Test

Test Chrome Firefox Safari
Verify the app package installs and operates as expected 🟑 :white_circle: :white_circle:
Upgrade agents and edit their groups 🟒 :white_circle: :white_circle:
Filter outdated agents 🟒 :white_circle: :white_circle:
Added macOS log collector tab to the agent configuration 🟒 :white_circle: 🟒
Added journald log collector tab to the agent configuration 🟒 :white_circle: :white_circle:
Changed agent log collector socket API response controller component 🟒 :white_circle: :white_circle:
Refactoring and redesign endpoints summary visualizations 🟒 :white_circle: 🟒
Added propagation of updates from the table to dashboard visualizations in Endpoints summary 🟒 :white_circle: :white_circle:
Replaced all Discover legacy implementations in favor of a custom discover view 🟒 :white_circle: 🟒
New filter handling system 🟒 :white_circle: 🟒
Refactored the search bar to correctly handle fixed and user-added filters 🟒 :white_circle: 🟒
Generate URL with predefined filters 🟒 :white_circle: 🟒
Added HAProxy helper settings to cluster configuration 🟒 :white_circle: :white_circle:
Disable the configuration editing with a wazuh.yml setting 🟒 :white_circle: :white_circle:
Enhance the validation for enrollment.dns on App Settings application 🟒 :white_circle: :white_circle:
Added ability to open the report file or Reporting application from the toast message 🟒 :white_circle: 🟒
Fixed an error of malformed table row on the generation of PDF reports πŸ”΄ :white_circle: :white_circle:
Changed the usage of the endpoint GET /groups/{group_id}/files/{file_name} 🟒 :white_circle: :white_circle:
Change the view of API is down and check connection to Server APIs application 🟒 :white_circle: :white_circle:
Refactored AngularJS controllers to React 🟒 :white_circle: :white_circle:
Upgraded versions of follow-redirects and es5-ext 🟒 :white_circle: :white_circle:
Removed installation date information 🟒 :white_circle: :white_circle:
Moved the registry data to in-memory cache 🟒 :white_circle: :white_circle:
Added support for agents to Office 365 🟒 :white_circle: 🟒
Remove some branding references across the application 🟒 :white_circle: :white_circle:
Improve margins and paddings in the Events, Inventory and Control tabs 🟒 :white_circle: :white_circle:
Fix refreshing index pattern fields does not include the scripted fields 🟒 :white_circle: :white_circle:
Fixed the sample alerts scripts to generate valid IP ranges and file hashes 🟒 :white_circle: :white_circle:
Fixed cronjob max seconds interval validation 🟒 :white_circle: :white_circle:
Fixed styles in small height viewports πŸ”΄ :white_circle: :white_circle:
Fixed behavior in Configuration Assessment when changing API 🟒 :white_circle: :white_circle:
Removed custom EuiSuggestItem component in favor of OUI's native component 🟒 :white_circle: :white_circle:
Removed legacy discover references and methods 🟒 :white_circle: :white_circle:
Verify the app package installs and operates as expected 🟑 > [!NOTE] > The case works but with some additional steps. All the test details in comment: https://github.com/wazuh/wazuh-dashboard-plugins/issues/6860#issuecomment-2246179561 This problem will be handled in the following issue: https://github.com/wazuh/wazuh-packages/issues/3056
Upgrade agents and edit their groups 🟒 > [!NOTE] > The test works as expected but the upgrade feature doesn't work because the 4.9.0 repository is not reachable right > now. The UI handles the error and works as expected. https://github.com/user-attachments/assets/087f7dac-ceba-452b-a37b-f58269887747 ![Screenshot 2024-07-24 at 10 19 23](https://github.com/user-attachments/assets/7f795708-6d68-4955-b8ab-ae287ca50426) https://github.com/user-attachments/assets/06e81387-7a7f-4bf5-91bd-734509535166 https://github.com/user-attachments/assets/f5085a2a-3daa-430d-8da4-50fdff003ca0 ## Safari ![Screenshot 2024-07-25 at 13 29 28](https://github.com/user-attachments/assets/6af61d2e-7430-46f1-934b-6914cc2fd49d)
Filter outdated agents 🟒 ![Screenshot 2024-07-24 at 10 20 55](https://github.com/user-attachments/assets/fa98bf50-78c0-4d32-842a-971171afe3d8)
Added macOS log collector tab to the agent configuration 🟒 Screenshot 2024-07-25 at 12 48 16
Added journald log collector tab to the agent configuration 🟒 ![Screenshot 2024-07-25 at 11 48 05](https://github.com/user-attachments/assets/046f5aa7-9a2d-4121-985c-6eee10a57416)
Changed agent log collector socket API response controller component 🟒 First, we need to add the socket configuration in agent ossec.conf Screenshot 2024-07-24 at 13 24 09
Refactoring and redesign endpoints summary visualizations 🟒 ![Screenshot 2024-07-24 at 13 33 59](https://github.com/user-attachments/assets/72286a33-a391-4864-9c11-ade7347d8ff6)
Added propagation of updates from the table to dashboard visualizations in Endpoints summary 🟒 https://github.com/user-attachments/assets/77ae4450-b730-4e6b-910d-60c60412717c
Replaced all Discover legacy implementations in favor of a custom discover view 🟒 > [!NOTE] > Is not necessary checks every event tabs because we are reusing the same component https://github.com/user-attachments/assets/bde75cc6-2d3f-4a91-a265-9fb3ead617ba ## Safari https://github.com/user-attachments/assets/e0d6fe47-33b5-4948-9990-f33d59ca9069
New filter handling system 🟒 https://github.com/user-attachments/assets/356c2881-62c5-46c2-a807-2519bb71c211
Refactored the search bar to correctly handle fixed and user-added filters 🟒 https://github.com/user-attachments/assets/3fd776e9-9317-466e-b887-2fdaf7f327fd ## Safari https://github.com/user-attachments/assets/38e38ba1-a93e-49a0-82af-1fa88a4e7278
Generate URL with predefined filters 🟒 https://github.com/user-attachments/assets/1d8476a4-4077-4b49-821d-4dc32c2a2e52
Added HAProxy helper settings to cluster configuration 🟒 ![Screenshot 2024-07-25 at 11 55 53](https://github.com/user-attachments/assets/408278bf-7713-4832-97a7-a7a87cf60acf) Screenshot 2024-07-26 at 09 01 17
Disable the configuration editing with a wazuh.yml setting 🟒 ![Screenshot 2024-07-24 at 15 08 41](https://github.com/user-attachments/assets/4ecaf56a-9320-4998-bb99-7d26da471a2c) ### The section was removed
Enhance the validation for enrollment.dns on App Settings application 🟒 ![Screenshot 2024-07-24 at 15 18 35](https://github.com/user-attachments/assets/0dabcc3e-aa04-4307-9847-6a6379da920f) ![Screenshot 2024-07-24 at 15 19 01](https://github.com/user-attachments/assets/d0f09e27-8eb4-439a-84ba-0cc85baa9dc2)
Added ability to open the report file or Reporting application from the toast message 🟒 https://github.com/user-attachments/assets/105fcb60-0d4a-4ce7-a921-9cd317dac0a0
Fixed an error of malformed table row on the generation of PDF reports πŸ”΄ https://github.com/user-attachments/assets/bcd44e1b-9f1a-4d13-97fc-9659f771ff2b Error in agent inventory data Generate report feature https://github.com/user-attachments/assets/e5d02cb9-f3c8-464a-b38c-c5f5073f09d4 ![Screenshot 2024-07-24 at 15 26 05](https://github.com/user-attachments/assets/bd06de08-3b8b-4783-9f3f-8d8c61cfba3c) ![Screenshot 2024-07-24 at 15 26 54](https://github.com/user-attachments/assets/fcc050aa-0b95-49db-82e8-05aee13d48d3) ![Screenshot 2024-07-24 at 15 26 44](https://github.com/user-attachments/assets/5b1a74c8-08af-418d-8963-29cbf437473c) https://github.com/user-attachments/assets/e1e5d4e6-1129-4254-a2d2-6eeef129fabd
Changed the usage of the endpoint GET /groups/{group_id}/files/{file_name} 🟒 ![Screenshot 2024-07-24 at 15 32 58](https://github.com/user-attachments/assets/f6d7ee52-b37d-48ef-bbcd-7b570bb94d41)
Change the view of API is down and check connection to Server APIs application 🟒 Screenshot 2024-07-25 at 10 18 54 Screenshot 2024-07-25 at 10 19 13
Refactored AngularJS controllers to React 🟒 https://github.com/user-attachments/assets/758cc8fa-ffd0-49a0-9e07-f9d6551cf8f7
Update follow-redirects and es5-ext dependencies version 🟒 > [!NOTE] > This fix Isn't a UI change but we can see the change in the following file: https://github.com/wazuh/wazuh-dashboard-plugins/blob/v4.9.0-alpha3/plugins/main/package.json#L17-L20
Removed installation date information 🟒 ![Screenshot 2024-07-24 at 16 43 42](https://github.com/user-attachments/assets/d5763eb6-2f32-4583-a880-20e2d50db498)
Moved the registry data to in-memory cache 🟒 ![Screenshot 2024-07-24 at 16 47 02](https://github.com/user-attachments/assets/41fa514d-ec40-41e6-9425-d8488f85c757)
Added support for agents to Office 365 🟒 Sample data doesn't have an event for an agent (not 000 agent.id). It's necessary to add a document with a specific agent.id manually to add the possibility of ping an agent ``` POST wazuh-alerts-4.x-sample-security/_doc { "@sampledata": true, "timestamp": "2024-07-19T19:54:00.530+0000", "rule": { "level": 3, "description": "Office 365: SharePoint events.", "id": "91536", "mail": false, "firedtimes": 3, "groups": [ "office365", "SharePoint", "hipaa_164.312.b", "pci_dss_10.6.2" ] }, "agent": { "id": "002", "ip": "145.80.240.15", "name": "ip-172-31-39-146" }, "manager": { "name": "ip-172-31-39-146" }, "cluster": { "name": "wazuh" }, "id": "1580123327.49031", "predecoder": {}, "decoder": { "name": "json" }, "data": { "integration": "Office365", "office365": { "CreationTime": "2024-07-16T19:54:00.530Z", "Id": "d14aa5cb-b070-42f8-8709-0f8afd942fc0", "Operation": "SharingPolicyChanged", "OrganizationId": "49fd4642-cfe5-4170-9488-25d847e3579f", "RecordType": 4, "UserKey": "c3482b5d-b1a9-4f44-8df0-a601e18cf5c3", "UserType": 4, "Version": 1, "Workload": "OneDrive", "ClientIP": "172.217.204.94", "ObjectId": "a8080009-aa85-4d65-a0f0-74fe0331edce", "UserId": "frank@wazuh.com", "CorrelationId": "fd9ac79d-1100-48aa-92c5-40a73a1d443f", "EventSource": "SharePoint", "ItemType": "Site", "Site": "f49feae4-033d-4028-97d1-3acd55341f69", "UserAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.212 Safari/537.36", "ModifiedProperties": [ { "Name": "ShareUsingAnonymousLinks", "NewValue": "Enabled", "OldValue": "Disabled" } ], "Subscription": "Audit.SharePoint", "ResultStatus": "Failed" } }, "location": "office365", "GeoLocation": { "country_name": "Germany", "location": { "lat": 52.524, "lon": 13.411 }, "region_name": "Berlin", "city_name": "Berlin" }, "@timestamp": "2024-07-19T19:54:00.530+0000" } ``` https://github.com/user-attachments/assets/955eb2ca-f248-4ff4-84b1-b8a95f818425 ## Safari https://github.com/user-attachments/assets/c0075a56-98af-4ebd-83e1-d2a5b0c420c1
Remove some branding references across the application 🟒 ![Screenshot 2024-07-24 at 16 50 13](https://github.com/user-attachments/assets/5ac2f4de-bf53-4827-9606-e5128a66b3dd)
Improve margins and paddings in the Events, Inventory and Control tabs 🟒 ![Screenshot 2024-07-24 at 16 52 36](https://github.com/user-attachments/assets/38046694-2922-4688-91dd-7a09a254fa83) ![Screenshot 2024-07-24 at 16 52 28](https://github.com/user-attachments/assets/43cfdbca-25a9-43b5-8a4d-ae4619a392e3) ## Safari https://github.com/user-attachments/assets/947a6073-79fb-4749-bd60-be603622c3cb
Fix refreshing index pattern fields does not include the scripted fields 🟒 ![Screenshot 2024-07-24 at 16 54 45](https://github.com/user-attachments/assets/632dc008-2b0c-4e9c-98d6-65e48cd5b80d) ![Screenshot 2024-07-24 at 16 56 18](https://github.com/user-attachments/assets/2103b81a-d234-4359-881f-73e01a3806d5)
Fixed the sample alerts scripts to generate valid IP ranges and file hashes 🟒 ![Screenshot 2024-07-24 at 17 00 22](https://github.com/user-attachments/assets/806bf038-5500-4d06-b3a8-1a12f57bfb01)
Fixed cronjob max seconds interval validation 🟒 > [!NOTE] > This fix Isn't a UI change but we can see the change in the following file: https://github.com/wazuh/wazuh-dashboard-plugins/blob/v4.9.0-alpha3/plugins/main/server/lib/parse-cron.ts#L28-L30
Fixed styles in small height viewports πŸ”΄ > [!NOTE] > If I click the full-screen button then cannot minimize the table because the minimize button is rendered below the top nav bar. This happens because the black bar should be disabled and it's not. It will be fixed: https://github.com/wazuh/wazuh-dashboard/issues/241 https://github.com/user-attachments/assets/b3f2b081-95b4-4f3a-8881-93ce8b787773 ![Screenshot 2024-07-24 at 17 03 36](https://github.com/user-attachments/assets/bbab91f5-187f-471f-9b10-e7c4c6accfea)
Fixed behavior in Configuration Assessment when changing API 🟒 https://github.com/user-attachments/assets/f3aa03f8-5280-43d6-856a-a0e5389ff245
Removed custom EuiSuggestItem component in favor of OUI's native component 🟒 https://github.com/user-attachments/assets/f663e54c-9826-47e1-9633-82aed07f585e
Removed legacy discover references and methods 🟒 https://github.com/user-attachments/assets/454fee91-6b8a-47bd-a919-18c7266b41b7
asteriscos commented 4 months ago

LGTM :heavy_check_mark: