elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.69k stars 24.66k forks source link

Data stream should exclude elastic built-in ones in telemetry #86258

Open Leaf-Lin opened 2 years ago

Leaf-Lin commented 2 years ago

Description

Today, data stream telemetry shows all data streams in the cluster:

### From GET _xpack/usage
"data_streams" : {
    "available" : true,
    "enabled" : true,
    "data_streams" : 4,
    "indices_count" : 4
},

However, many of them are built-in from Elastic or the connected products like:

Thus, it's not easy to know the real adoption of data stream. Is it possible to exclude certain indices from _xpack/usage when counting data_streams.indices_count? Or just have another field called data.streams.system_indices_count?

elasticmachine commented 2 years ago

Pinging @elastic/es-data-management (Team:Data Management)