search

elastic / cloud-on-k8s

Elastic Cloud on Kubernetes
Other
2.52k stars 686 forks source link

Include all the metricsets to Metricbeat collected monitoring data #7277

Open fdartayre opened 8 months ago

fdartayre commented 8 months ago

When shipping metrics with Stack monitoring, include all the metricsets in the Elasticsearch module of Metricbeat.

Today only a subset is configured. As a result, the ingest pipelines view in Stack monitoring is empty for example.

pebrc commented 8 months ago

We need to make this version specific as this metricset seems to exist only since 8.7

gui-elastic commented 3 weeks ago

Hello,

I have a question. Should this be considered a bug or an enhancement request? I am asking that because this problem really impacts any attempt to monitor Ingest Pipeline if you use an ECK cluster monitored using the ECK Stack Monitoring.

The workaround I found for this situation was to configure custom args for the Metricbeat container by following the steps described here.

The final workaround would be as in the example below:

    podTemplate:
      spec:
        containers:
        - name: metricbeat
          args: 
          - "-c"
          - "/etc/metricbeat-config/metricbeat.yml"
          - "-E" 
          - "metricbeat.modules=[{module: elasticsearch, metricsets: ['node', 'node_stats', 'ccr', 'cluster_stats', 'enrich', 'index', 'index_recovery', 'index_summary', 'ml_job', 'shard', 'ingest_pipeline']}]"
          - "-e"