elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
108 stars 4.93k forks source link

Evaluate the performance impact of index.mapping.total_fields.limit for metricbeat #41705

Open AndersonQ opened 1 day ago

AndersonQ commented 1 day ago

The current index.mapping.total_fields.limit for metricbeat (and any beat using the libbeat setup command) is 12,500, which was just increased as 10,000 wan't enough anymore. As this setting can impact elasticsearch's performance, it's important to have actual performance measurements if we're to ever increase it again.

The impacts on performance need to be evaluated for:

This is actually a elasticsearch performance investigation, not specifically for metricbeat. Any test might use metricbeat or any other tool capable of producing events similar to what metricbeat might produce.

elasticmachine commented 1 day ago

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)