search

jenkinsci / opentelemetry-plugin

Monitor and observe Jenkins with OpenTelemetry.
https://plugins.jenkins.io/opentelemetry/
Apache License 2.0
94 stars 46 forks source link

opentelemetry-plugin >=2.2.1 won't work with opentelemetry-collector #380

Closed sappersd closed 2 years ago

sappersd commented 2 years ago

Jenkins and plugins versions report

Environment ```text Jenkins: 2.339 OS: Linux - 5.4.181-1.el7.elrepo.x86_64 --- Parameterized-Remote-Trigger:3.1.5.1 ace-editor:1.1 active-directory:2.25.1 allure-jenkins-plugin:2.30.2 analysis-model-api:10.9.3 ansible:1.1 ansicolor:1.0.1 ant:1.13 antisamy-markup-formatter:2.7 apache-httpcomponents-client-4-api:4.5.13-1.0 artifactory:3.15.3 authentication-tokens:1.4 aws-java-sdk:1.12.163-315.v2b_716ec8e4df aws-java-sdk-cloudformation:1.12.163-315.v2b_716ec8e4df aws-java-sdk-codebuild:1.12.163-315.v2b_716ec8e4df aws-java-sdk-ec2:1.12.163-315.v2b_716ec8e4df aws-java-sdk-ecr:1.12.163-315.v2b_716ec8e4df aws-java-sdk-ecs:1.12.163-315.v2b_716ec8e4df aws-java-sdk-elasticbeanstalk:1.12.163-315.v2b_716ec8e4df aws-java-sdk-iam:1.12.163-315.v2b_716ec8e4df aws-java-sdk-logs:1.12.163-315.v2b_716ec8e4df aws-java-sdk-minimal:1.12.163-315.v2b_716ec8e4df aws-java-sdk-ssm:1.12.163-315.v2b_716ec8e4df aws-secrets-manager-credentials-provider:1.0.0 aws-secrets-manager-secret-source:0.0.2 bootstrap4-api:4.6.0-3 bootstrap5-api:5.1.3-6 bouncycastle-api:2.25 branch-api:2.7.0 build-name-setter:2.2.0 build-pipeline-plugin:1.5.8 build-timeout:1.20 build-timestamp:1.0.3 build-user-vars-plugin:1.8 buildrotator:1.2 caffeine-api:2.9.2-29.v717aac953ff3 checks-api:1.7.2 cloudbees-disk-usage-simple:0.10 cloudbees-folder:6.708.ve61636eb_65a_5 cobertura:1.17 code-coverage-api:2.0.4 command-launcher:1.6 conditional-buildstep:1.4.1 config-file-provider:3.9.0 configuration-as-code:1414.v878271fc496f configuration-as-code-groovy:1.1 copyartifact:1.46.3 credentials:1074.v60e6c29b_b_44b_ credentials-binding:1.27.1 custom-tools-plugin:0.8 dashboard-view:2.18 data-tables-api:1.11.4-3 display-url-api:2.3.5 docker-build-publish:1.3.3 docker-commons:1.19 docker-java-api:3.1.5.2 docker-plugin:1.2.6 docker-workflow:1.28 dtkit-api:3.0.0 durable-task:493.v195aefbb0ff2 dynamic_extended_choice_parameter:1.0.1 echarts-api:5.3.0-2 email-ext:2.87 emailext-template:1.4 envinject:2.839.v52c702c10635 envinject-api:1.180.v98d833b_27470 extended-choice-parameter:346.vd87693c5a_86c extended-read-permission:3.2 extensible-choice-parameter:1.8.0 external-monitor-job:191.v363d0d1efdf8 files-found-trigger:1.5 fluentd:0.1.5 font-awesome-api:6.0.0-1 forensics-api:1.12.0 generic-webhook-trigger:1.83 git:4.10.3 git-client:3.11.0 git-parameter:0.9.15 git-server:1.10 github:1.34.3 github-api:1.301-378.v9807bd746da5 github-autostatus:3.6.2 github-branch-source:1583.v18d333ef7379 gitlab-plugin:1.5.29 google-oauth-plugin:1.0.6 gradle:1.38 groovy:2.4 h2-api:1.4.199 handlebars:3.0.8 hashicorp-vault-plugin:336.v182c0fbaaeb7 hidden-parameter:0.0.4 htmlpublisher:1.29 http_request:1.14 ivy:2.1 jackson2-api:2.13.2-260.v43d711474c77 jacoco:3.3.1 javadoc:217.v905b_86277a_2a_ javax-activation-api:1.2.0-2 javax-mail-api:1.6.2-5 jaxb:2.3.0.1 jdk-tool:1.5 jersey2-api:2.35-4 jira-steps:1.6.0 jjwt-api:0.11.2-9.c8b45b8bb173 jnr-posix-api:3.1.7-2 job-dsl:1.78.3 job-parameter-summary:0.5 jquery:1.12.4-1 jquery-detached:1.2.1 jquery3-api:3.6.0-2 jsch:0.1.55.2 junit:1.56 junit-attachments:92.v46b_185115f82 kubernetes:3546.v6103d89542d6 kubernetes-client-api:5.11.2-182.v0f1cf4c5904e kubernetes-credentials:0.9.0 ldap:2.8 lockable-resources:2.14 mailer:408.vd726a_1130320 mapdb-api:1.0.9.0 mask-passwords:3.0 matrix-auth:3.1 matrix-groovy-execution-strategy:1.0.7 matrix-project:758.v7a_ea_491852f3 maven-artifact-choicelistprovider:1.9.0 maven-plugin:3.18 metrics:4.1.6.1 momentjs:1.1.1 monitoring:1.90.0 nc-jenkins-jobs-importer-plugin:2.0.0 nodejs:1.5.1 oauth-credentials:0.5 okhttp-api:4.9.3-105.vb96869f8ac3a opentelemetry:2.2.2 pam-auth:1.7 parameterized-scheduler:1.0 parameterized-trigger:2.43 performance:3.20 permissive-script-security:0.7 pipeline-aggregator-view:1.11 pipeline-build-step:2.16 pipeline-github-lib:36.v4c01db_ca_ed16 pipeline-graph-analysis:188.v3a01e7973f2c pipeline-input-step:446.vf27b_0b_83500e pipeline-maven:3.10.0 pipeline-milestone-step:100.v60a_03cd446e1 pipeline-model-api:2.2064.v5eef7d0982b_e pipeline-model-definition:2.2064.v5eef7d0982b_e pipeline-model-extensions:2.2064.v5eef7d0982b_e pipeline-rest-api:2.23 pipeline-stage-step:291.vf0a8a7aeeb50 pipeline-stage-tags-metadata:2.2064.v5eef7d0982b_e pipeline-stage-view:2.23 pipeline-utility-steps:2.12.0 plain-credentials:1.8 plugin-util-api:2.14.0 popper-api:1.16.1-2 popper2-api:2.11.2-1 prism-api:1.26.0-2 publish-over:0.22 python:1.3 rebuild:1.33 remoting-opentelemetry:1.0-rc89.d67d14d05962 resource-disposer:0.17 rich-text-publisher-plugin:1.4 role-strategy:3.2.0 run-condition:1.5 saml:2.291.vd3f2cd6d1c3e scm-api:595.vd5a_df5eb_0e39 scoring-load-balancer:1.0.1 script-security:1140.vf967fb_efa_55a_ simple-theme-plugin:103.va_161d09c38c7 slave-setup:1.10 snakeyaml-api:1.29.1 ssh-agent:1.24.1 ssh-credentials:1.19 ssh-slaves:1.806.v2253cedd3295 sshd:3.1.0 structs:308.v852b473a2b8c subversion:2.15.2 throttle-concurrents:2.6 timestamper:1.17 token-macro:280.v97a_82642793c trilead-api:1.0.13 uno-choice:2.6.0 update-sites-manager:2.0.0 variant:1.4 versioncolumn:2.2 warnings-ng:9.11.1 windows-slaves:1.8 workflow-aggregator:2.7 workflow-api:1143.v2d42f1e9dea_5 workflow-basic-steps:941.vdfe1b_a_132c64 workflow-cps:2660.vb_c0412dc4e6d workflow-cps-global-lib:564.ve62a_4eb_b_e039 workflow-durable-task-step:1121.va_65b_d2701486 workflow-job:1174.vdcb_d054cf74a_ workflow-multibranch:711.vdfef37cda_816 workflow-remote-loader:1.5 workflow-scm-step:2.13 workflow-step-api:622.vb_8e7c15b_c95a_ workflow-support:815.vd60466279fc8 ws-cleanup:0.40 xunit:3.0.5 ```

What Operating System are you using (both controller, and any agents involved in the problem)?

CentOS 8 Stream

Reproduction steps

I try to use opentelemetry-plugin for sending metrics to prometheus using opentelemetry-collector. But it won't work. jenkins (opentelemetry-plugin) -> opentelemetry-collector -> prometheus

There are only few metrics appear into prometheus:

otlp_exporter_seen counter
processedSpans counter
queueSize gauge
spans_duration_nano gauge
spans_end_time_unix_nano gauge
spans_response_status gauge

A lot of metrics (I can see it if using Observability Elastic) are absent.

But if I send custom metrics by telegraf (opentelemetry plugin) - I can see metrics into prometheus. 

otel/opentelemetry-collector:0.47.0
prom/prometheus:v2.34.0
Telegraf 1.21.4

opentelemetry-collector config:

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: "0.0.0.0:4317"
exporters:
  prometheus:
    endpoint: "0.0.0.0:8889"
    const_labels:
      label1: value1
processors:
  batch:
service:
  pipelines:
    metrics:
      receivers: [otlp]
      processors: [batch]
      exporters: [prometheus]

telegraf that can send data to collector and metrics will appear into prometheus

[tags]
[agent]
  interval = "3s"
  round_interval = true
  metric_batch_size = 1000
  metric_buffer_limit = 10000
  collection_jitter = "0s"
  flush_interval = "10s"
  flush_jitter = "0s"
  debug = false
  quiet = false
  hostname = "localhost"
  omit_hostname = false
[outputs]
[[outputs.opentelemetry]]
service_address = "otel-collector:4317"

[[inputs.exec]]
  commands = [ "/etc/telegraf/scripts/*" ]
  name_prefix = "t_jenkins_"
  data_format = "influx"
  timeout = "30s"
  interval = "10s"

Is it a protocol incompatibility? Or is it my inncorrect configuration?

By the way, if I use last opentelemetry-plugin 2.3.0, than no one metric appear into prometheus.

Expected Results

-

Actual Results

-

Anything else?

No response

cyrille-leclerc commented 2 years ago

We continuously test with Otel Collector (0.44.0 for me today) and we use on our production Elastic Jenkins instances with the Otel Collector. I'll deep dive on your problem.

cyrille-leclerc commented 2 years ago

I see the Jenkins metrics verifying on the Prometheus Exposition Format web page published by the Otel Collector Contrib 0.47.0

otel-collector.yml ```yaml receivers: otlp: protocols: grpc: endpoint: '127.0.0.1:4317' #... extensions: zpages: endpoint: :55679 receivers: otlp: protocols: grpc: endpoint: '127.0.0.1:4317' hostmetrics: collection_interval: 1m scrapers: # cpu not supported on MacOS # cpu: load: memory: processors: batch: exporters: otlp/elasticcloud: endpoint: "***.apm.europe-west1.gcp.cloud.es.io:443" headers: Authorization: "Bearer ***" logging: loglevel: warn logging/debug: loglevel: debug prometheus: endpoint: 0.0.0.0:8889 resource_to_telemetry_conversion: enabled: true service: pipelines: metrics: receivers: - otlp - hostmetrics processors: [batch] exporters: - logging - prometheus - otlp/elasticcloud traces: receivers: - otlp processors: [batch] exporters: - otlp/elasticcloud logs: receivers: [otlp] processors: [batch] exporters: - logging/debug - otlp/elasticcloud extensions: [zpages] ```
http://localhost:8889/metrics ``` # HELP ci_pipeline_run_completed Job completed # TYPE ci_pipeline_run_completed counter ci_pipeline_run_completed{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP ci_pipeline_run_launched Job launched # TYPE ci_pipeline_run_launched counter ci_pipeline_run_launched{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP ci_pipeline_run_started Job started # TYPE ci_pipeline_run_started counter ci_pipeline_run_started{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP jenkins_agents_offline Number of offline agents # TYPE jenkins_agents_offline gauge jenkins_agents_offline{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP jenkins_agents_online Number of online agents # TYPE jenkins_agents_online gauge jenkins_agents_online{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP jenkins_agents_total Number of agents # TYPE jenkins_agents_total gauge jenkins_agents_total{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2 # HELP jenkins_disk_usage_bytes Disk usage of first level folder in JENKINS_HOME. # TYPE jenkins_disk_usage_bytes gauge jenkins_disk_usage_bytes{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.43768832e+09 # HELP jenkins_queue_blocked Number of blocked items in queue # TYPE jenkins_queue_blocked gauge jenkins_queue_blocked{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP jenkins_queue_buildable Number of buildable items in queue # TYPE jenkins_queue_buildable gauge jenkins_queue_buildable{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP jenkins_queue_left Total count of left items # TYPE jenkins_queue_left counter jenkins_queue_left{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2 # HELP jenkins_queue_time_spent_millis Total time spent in queue by items # TYPE jenkins_queue_time_spent_millis counter jenkins_queue_time_spent_millis{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 102 # HELP jenkins_queue_waiting Number of waiting items in queue # TYPE jenkins_queue_waiting gauge jenkins_queue_waiting{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP login Logins # TYPE login counter login{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP login_success Successful logins # TYPE login_success counter login_success{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP otlp_exporter_exported # TYPE otlp_exporter_exported counter otlp_exporter_exported{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="log"} 161 otlp_exporter_exported{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 196 # HELP otlp_exporter_seen # TYPE otlp_exporter_seen counter otlp_exporter_seen{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="log"} 161 otlp_exporter_seen{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 196 # HELP process_cpu_load Process CPU load # TYPE process_cpu_load gauge process_cpu_load{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.023051337388955356 # HELP process_cpu_time Process CPU time # TYPE process_cpu_time counter process_cpu_time{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.46431498e+11 # HELP processedLogs The number of logs processed by the BatchLogProcessor. [dropped=true if they were dropped due to high throughput] # TYPE processedLogs counter processedLogs{dropped="false",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",logProcessorType="BatchLogProcessor",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 161 # HELP processedSpans The number of spans processed by the BatchSpanProcessor. [dropped=true if they were dropped due to high throughput] # TYPE processedSpans counter processedSpans{dropped="false",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 196 # HELP queueSize The number of spans queued # TYPE queueSize gauge queueSize{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP runtime_jvm_gc_count The number of collections that have occurred for a given JVM garbage collector. # TYPE runtime_jvm_gc_count gauge runtime_jvm_gc_count{gc="G1 Old Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 runtime_jvm_gc_count{gc="G1 Young Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 68 # HELP runtime_jvm_gc_time Time spent in a given JVM garbage collector in milliseconds. # TYPE runtime_jvm_gc_time gauge runtime_jvm_gc_time{gc="G1 Old Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 runtime_jvm_gc_time{gc="G1 Young Generation",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 671 # HELP runtime_jvm_memory_area Bytes of a given JVM memory area. # TYPE runtime_jvm_memory_area gauge runtime_jvm_memory_area{area="heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.009071616e+09 runtime_jvm_memory_area{area="heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 4.294967296e+09 runtime_jvm_memory_area{area="heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 7.76192512e+08 runtime_jvm_memory_area{area="non_heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.03186176e+08 runtime_jvm_memory_area{area="non_heap",host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.89695912e+08 # HELP runtime_jvm_memory_pool Bytes of a given JVM memory pool. # TYPE runtime_jvm_memory_pool gauge runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.555904e+06 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 5.8368e+06 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.422784e+06 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.1730944e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22912768e+08 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.171648e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 3.538944e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22908672e+08 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="CodeHeap 'profiled nmethods'",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 3.5292288e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Compressed Class Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.8558976e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Compressed Class Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.073741824e+09 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Compressed Class Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.536776e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Eden Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.214251008e+09 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Eden Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 6.20756992e+08 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Old Gen",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 7.43440384e+08 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Old Gen",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 4.294967296e+09 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Old Gen",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.04055296e+08 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Survivor Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 5.1380224e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="G1 Survivor Space",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 5.1380224e+07 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Metaspace",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.34950912e+08 runtime_jvm_memory_pool{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",pool="Metaspace",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.248966e+08 # HELP system_cpu_load System CPU load # TYPE system_cpu_load gauge system_cpu_load{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.3945170093535821 # HELP system_cpu_load_average_15m Average CPU Load over 15 minutes. # TYPE system_cpu_load_average_15m gauge system_cpu_load_average_15m 6.3857421875 # HELP system_cpu_load_average_1m System CPU load average 1 minute # TYPE system_cpu_load_average_1m gauge system_cpu_load_average_1m{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 7.4169921875 # HELP system_cpu_load_average_5m Average CPU Load over 5 minutes. # TYPE system_cpu_load_average_5m gauge system_cpu_load_average_5m 9.19677734375 # HELP system_memory_usage Bytes of memory in use. # TYPE system_memory_usage gauge system_memory_usage{state="free"} 1.51937024e+08 system_memory_usage{state="inactive"} 5.54848256e+09 system_memory_usage{state="used"} 1.14794496e+10 # HELP system_memory_utilization System memory utilization (0.0 to 1.0) # TYPE system_memory_utilization gauge system_memory_utilization{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.9924924373626709 # HELP system_paging_usage System swap usage # TYPE system_paging_usage gauge system_paging_usage{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",state="free",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 6.58505728e+08 system_paging_usage{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",state="used",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 4.710203392e+09 # HELP system_paging_utilization System swap utilization (0.0 to 1.0) # TYPE system_paging_utilization gauge system_paging_utilization{host_arch="x86_64",host_name="MacBook-Pro.localdomain",jenkins_opentelemetry_plugin_version="2.3.0",jenkins_url="http://localhost:8080/",jenkins_version="2.332.1",os_description="Mac OS X 11.3",os_type="darwin",process_runtime_description="AdoptOpenJDK OpenJDK 64-Bit Server VM 11.0.11+9",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.11+9",service_name="jenkins",service_namespace="jenkins",service_version="2.332.1",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.87734375 ```
cyrille-leclerc commented 2 years ago

@sappersd can you verify with a curl http://localhost:8889/metrics if your Jenkins metrics are captured?

sappersd commented 2 years ago

Thx a lot for your help!

opentelemetry-collector:0.47.0 OpenTelemetry Plugin Version 2.2.1

I just copied your config for collector plugin:

otel-collector-config.yaml ``` extensions: zpages: endpoint: :55679 receivers: otlp: protocols: grpc: endpoint: '0.0.0.0:4317' hostmetrics: collection_interval: 1m scrapers: # cpu not supported on MacOS # cpu: load: memory: processors: batch: exporters: otlp/elasticcloud: endpoint: "zzzz:443" headers: Authorization: "Bearer ***" logging: loglevel: warn logging/debug: loglevel: debug prometheus: endpoint: 0.0.0.0:8889 resource_to_telemetry_conversion: enabled: true service: pipelines: metrics: receivers: - otlp - hostmetrics processors: [batch] exporters: - logging - prometheus - otlp/elasticcloud traces: receivers: - otlp processors: [batch] exporters: - otlp/elasticcloud logs: receivers: [otlp] processors: [batch] exporters: - logging/debug - otlp/elasticcloud extensions: [zpages] ```
curl 127.0.0.1:8889/metrics ``` # HELP otlp_exporter_exported # TYPE otlp_exporter_exported counter otlp_exporter_exported{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 5 # HELP otlp_exporter_seen # TYPE otlp_exporter_seen counter otlp_exporter_seen{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 5 # HELP processedSpans The number of spans processed by the BatchSpanProcessor. [dropped=true if they were dropped due to high throughput] # TYPE processedSpans counter processedSpans{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",dropped="false",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 5 # HELP queueSize The number of spans queued # TYPE queueSize gauge queueSize{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP system_cpu_load_average_15m Average CPU Load over 15 minutes. # TYPE system_cpu_load_average_15m gauge system_cpu_load_average_15m 0.05 # HELP system_cpu_load_average_1m Average CPU Load over 1 minute. # TYPE system_cpu_load_average_1m gauge system_cpu_load_average_1m 0 # HELP system_cpu_load_average_5m Average CPU Load over 5 minutes. # TYPE system_cpu_load_average_5m gauge system_cpu_load_average_5m 0.01 # HELP system_memory_usage Bytes of memory in use. # TYPE system_memory_usage gauge system_memory_usage{state="buffered"} 0 system_memory_usage{state="cached"} 4.525432832e+09 system_memory_usage{state="free"} 2.79762944e+09 system_memory_usage{state="slab_reclaimable"} 5.38079232e+08 system_memory_usage{state="slab_unreclaimable"} 1.74862336e+08 system_memory_usage{state="used"} 8.777728e+08 ```

And here are logs for OpenTelemetry Plugin Version 2.3.1-SNAPSHOT (private-d73fc646-root)

curl 127.0.0.1:8889/metrics ``` # HELP jenkins_agents_offline Number of offline agents # TYPE jenkins_agents_offline gauge jenkins_agents_offline{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP jenkins_agents_online Number of online agents # TYPE jenkins_agents_online gauge jenkins_agents_online{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP jenkins_agents_total Number of agents # TYPE jenkins_agents_total gauge jenkins_agents_total{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP jenkins_disk_usage_bytes Disk usage of first level folder in JENKINS_HOME. # TYPE jenkins_disk_usage_bytes gauge jenkins_disk_usage_bytes{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.293890048e+09 # HELP login Logins # TYPE login counter login{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP login_success Successful logins # TYPE login_success counter login_success{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 # HELP otlp_exporter_exported # TYPE otlp_exporter_exported counter otlp_exporter_exported{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 9 otlp_exporter_exported{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",success="true",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 191 # HELP otlp_exporter_seen # TYPE otlp_exporter_seen counter otlp_exporter_seen{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 9 otlp_exporter_seen{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="span"} 191 # HELP process_cpu_load Process CPU load # TYPE process_cpu_load gauge process_cpu_load{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.23484848484848486 # HELP process_cpu_time Process CPU time # TYPE process_cpu_time counter process_cpu_time{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.94552e+12 # HELP processedSpans The number of spans processed by the BatchSpanProcessor. [dropped=true if they were dropped due to high throughput] # TYPE processedSpans counter processedSpans{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",dropped="false",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 9 processedSpans{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",dropped="false",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 191 # HELP queueSize The number of spans queued # TYPE queueSize gauge queueSize{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.2.1",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 1 queueSize{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",spanProcessorType="BatchSpanProcessor",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP runtime_jvm_gc_count The number of collections that have occurred for a given JVM garbage collector. # TYPE runtime_jvm_gc_count gauge runtime_jvm_gc_count{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Old Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 runtime_jvm_gc_count{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Young Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 24 # HELP runtime_jvm_gc_time Time spent in a given JVM garbage collector in milliseconds. # TYPE runtime_jvm_gc_time gauge runtime_jvm_gc_time{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Old Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 runtime_jvm_gc_time{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",gc="G1 Young Generation",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2111 # HELP runtime_jvm_memory_area Bytes of a given JVM memory area. # TYPE runtime_jvm_memory_area gauge runtime_jvm_memory_area{area="heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.075838976e+09 runtime_jvm_memory_area{area="heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 2.147483648e+09 runtime_jvm_memory_area{area="heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.65494528e+08 runtime_jvm_memory_area{area="non_heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.54214144e+08 runtime_jvm_memory_area{area="non_heap",container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.33895104e+08 # HELP runtime_jvm_memory_pool Bytes of a given JVM memory pool. # TYPE runtime_jvm_memory_pool gauge runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.752512e+06 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 5.828608e+06 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.655872e+06 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.0354688e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22916864e+08 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'non-profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 9.762304e+06 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 3.8207488e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.22912768e+08 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="CodeHeap 'profiled nmethods'",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 3.607296e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Compressed Class Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 2.5296896e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Compressed Class Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 1.073741824e+09 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Compressed Class Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 2.105196e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Eden Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 6.33339904e+08 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Eden Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 5.1380224e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Old Gen",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 3.99507456e+08 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Old Gen",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="max"} 2.147483648e+09 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Old Gen",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.71122688e+08 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Survivor Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 4.2991616e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="G1 Survivor Space",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 4.2991616e+07 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Metaspace",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="committed"} 1.7760256e+08 runtime_jvm_memory_pool{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",pool="Metaspace",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0",type="used"} 1.64352008e+08 # HELP system_cpu_load System CPU load # TYPE system_cpu_load gauge system_cpu_load{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.008546816960784314 # HELP system_cpu_load_average_15m Average CPU Load over 15 minutes. # TYPE system_cpu_load_average_15m gauge system_cpu_load_average_15m 0.05 # HELP system_cpu_load_average_1m System CPU load average 1 minute # TYPE system_cpu_load_average_1m gauge system_cpu_load_average_1m{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 2.38 # HELP system_cpu_load_average_5m Average CPU Load over 5 minutes. # TYPE system_cpu_load_average_5m gauge system_cpu_load_average_5m 0.01 # HELP system_memory_usage Bytes of memory in use. # TYPE system_memory_usage gauge system_memory_usage{state="buffered"} 0 system_memory_usage{state="cached"} 4.525502464e+09 system_memory_usage{state="free"} 2.782609408e+09 system_memory_usage{state="slab_reclaimable"} 5.38079232e+08 system_memory_usage{state="slab_unreclaimable"} 1.74923776e+08 system_memory_usage{state="used"} 8.927232e+08 # HELP system_memory_utilization System memory utilization (0.0 to 1.0) # TYPE system_memory_utilization gauge system_memory_utilization{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0.7312078475952148 # HELP system_paging_usage System swap usage # TYPE system_paging_usage gauge system_paging_usage{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",state="free",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 system_paging_usage{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",state="used",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 # HELP system_paging_utilization System swap utilization (0.0 to 1.0) # TYPE system_paging_utilization gauge system_paging_utilization{container_id="51f33897caee3a95bd2b3dacf57d0a61263b8e71c3ae116d2d95185da8d1dc6a",host_arch="amd64",host_name="appdeployer-master-547bf5dc76-v2h5d",jenkins_opentelemetry_plugin_version="2.3.1-SNAPSHOT (private-d73fc646-root)",jenkins_url="myhost.mydomain.com",jenkins_version="2.339",os_description="Linux 5.4.181-1.el7.elrepo.x86_64",os_type="linux",process_runtime_description="Red Hat, Inc. OpenJDK 64-Bit Server VM 11.0.14+9-LTS",process_runtime_name="OpenJDK Runtime Environment",process_runtime_version="11.0.14+9-LTS",service_name="jenkins",service_namespace="jenkins",service_version="2.339",telemetry_sdk_language="java",telemetry_sdk_name="opentelemetry",telemetry_sdk_version="1.12.0"} 0 ```
sappersd commented 2 years ago

I rechecked v2.2.1 - It works as well (there was my mistake into config first time) It looks like my problem was related with:

    resource_to_telemetry_conversion:
        enabled: true

I am very grateful for your help! But could you please update demos for new versions.

cyrille-leclerc commented 2 years ago

Thanks. Can you confirm we can close the issue?

FYI https://github.com/jenkinsci/opentelemetry-plugin/pull/381

sappersd commented 2 years ago

Yes. Thank you.

cyrille-leclerc commented 2 years ago

Hello @sappersd , we run a survey to better understand Jenkins Observability needs and more broadly CI/CD Observability needs, could you by any chance answer it? https://docs.google.com/forms/d/e/1FAIpQLSezbndR1bpPj4YeWquLLWEYOkEjEI-lSyNbtDUVrR-udpt2lA/viewform?usp=sf_link