elastic / integrations

Elastic Integrations
https://www.elastic.co/integrations
Other
30 stars 447 forks source link

mimecast: add support for v2 API endpoints #11782

Open efd6 opened 2 days ago

efd6 commented 2 days ago

Proposed commit message

Migrate the message_release_logs agent to the Mimecast v2 API and add v2 API
agents for:

* archive_search_logs
* audit_events
* dlp_logs
* threat_intel_malware_customer
* threat_intel_malware_grid
* ttp_ap_logs
* ttp_ip_logs
* ttp_url_logs

The migration of message_release_logs means that this is a breaking change.

[!NOTE] The addition of siem_logs v2 support depends in a stack upgrade, so that will be done in a future PR so that users on v8.14.x can get the benefit of the v2 change for the other endpoints.

[!NOTE] Test vectors for the ttp_ip_logs were not available from the test instance. If they become available they will be added. In the meantime, the change here uses v1 data via a v2 API call structure. This is likely OK since the majority of v2 data shapes match the v1 shape.

[!NOTE] Best reviewed commit-wise.

The commits can be grouped in to families:

  • common:
    • archive_search_logs
    • dlp_logs
    • message_release_logs
    • ttp_ap_logs
    • ttp_ip_logs
    • ttp_url_logs
  • audit
    • audit_events
  • malware:
    • threat_intel_malware_customer
    • threat_intel_malware_grid

Checklist

Author's Checklist

How to test this PR locally

Related issues

Screenshots

Default state (minimised)

Screenshot from 2024-11-21 08-08-45

Mimecast v1 data streams

Screenshot from 2024-11-21 08-09-25

Mimecast v2 data streams

Screenshot from 2024-11-21 08-09-46

elastic-vault-github-plugin-prod[bot] commented 2 days ago

:rocket: Benchmarks report

To see the full report comment with /test benchmark fullreport

elasticmachine commented 2 days ago

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

elasticmachine commented 1 day ago

:green_heart: Build Succeeded

History

cc @efd6

elastic-sonarqube[bot] commented 1 day ago

Quality Gate passed Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
99.1% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube