elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
12.06k stars 4.89k forks source link

Improve Azure Monitor scalability and performance #38624

Open zmoog opened 3 months ago

zmoog commented 3 months ago

The Azure Monitor metricset can collect metrics for Azure resources such as VMs, database accounts, and more.

However, the current implementation limits how many Azure resources it can collect metrics for. As of 8.13, the limit is ~120 for PT1M metrics and ~400 for PT5M metrics. Beyond these limits, the metricset may only sometimes be able to collect values every 60s and 300s as necessary.

We plan to improve the performance and scalability of the metricset by introducing two changes:

Relates to: https://github.com/elastic/integrations/issues/8575

elasticmachine commented 3 months ago

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)