search

DataDog / datadog-agent

Main repository for Datadog Agent
https://docs.datadoghq.com/
Apache License 2.0
2.87k stars 1.21k forks source link

Disk metrics missing #12427

Closed gs11 closed 2 years ago

gs11 commented 2 years ago

Output of the info page (if this is a bug)

2022-06-16 23:26:16 CEST | CORE | WARN | (pkg/util/log/log.go:591 in func1) | Deactivating Autoconfig will disable most components. It's recommended to use autoconfig_exclude_features and autoconfig_include_features to activate/deactivate features selectively
2022-06-16 23:26:16 CEST | CORE | INFO | (cmd/agent/app/status.go:125 in requestStatus) | Getting the status from the agent.
2022-06-16 23:26:16 CEST | CORE | INFO | (cmd/agent/app/status.go:163 in requestStatus) | =====================================
Agent (v7.38.0-devel+git.200.45946d9)
=====================================
  Status date: 2022-06-16 23:26:16.663 CEST / 2022-06-16 21:26:16.663 UTC (1852367703)
  Agent start: 2022-06-16 23:21:26.037 CEST / 2022-06-16 21:21:26.037 UTC (1852077077)
  Pid: 23682
  Go Version: go1.18.3
  Python Version: n/a
  Build arch: arm
  Agent flavor: agent
  Check Runners: 4
  Log Level: info
  Paths
  =====
    Config File: /etc/datadog-agent/datadog.yaml
    conf.d: /etc/datadog-agent/conf.d
    checks.d: /etc/datadog-agent/checks.d
  Clocks
  ======
    NTP offset: -5.089ms
    System time: 2022-06-16 23:26:16.663 CEST / 2022-06-16 21:26:16.663 UTC (1852367703)
  Host Info
  =========
    bootTime: 2022-05-13 21:47:35 CEST / 2022-05-13 19:47:35 UTC (-1091153960)
    hostId: 6863a4a7-04a4-49d0-b339-7f55bec3e7ce
    kernelArch: armv7l
    kernelVersion: 5.15.32-v7l+
    os: linux
    platform: raspbian
    platformFamily: debian
    platformVersion: 11.3
    procs: 180
    uptime: 817h34m1s
  Hostnames
  =========
    hostname: ....
    socket-fqdn: ...
    socket-hostname: ...
    hostname provider: os
    unused hostname providers:
      aws: not retrieving hostname from AWS: the host is not an ECS instance and other providers already retrieve non-default hostnames
      azure: azure_hostname_style is set to 'os'
      configuration/environment: hostname is empty
      gce: unable to retrieve hostname from GCE: GCE metadata API error: Get "http://169.254.169.254/computeMetadata/v1/instance/hostname": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
  Metadata
  ========
    agent_version: 7.38.0-devel+git.200.45946d9
    config_apm_dd_url: 
    config_dd_url: 
    config_logs_dd_url: 
    config_logs_socks5_proxy_address: 
    config_no_proxy: []
    config_process_dd_url: 
    config_proxy_http: 
    config_proxy_https: 
    config_site: 
    feature_apm_enabled: true
    feature_cspm_enabled: false
    feature_cws_enabled: false
    feature_logs_enabled: false
    feature_networks_enabled: false
    feature_networks_http_enabled: false
    feature_networks_https_enabled: false
    feature_otlp_enabled: false
    feature_process_enabled: false
    feature_processes_container_enabled: true
    flavor: agent
    hostname_source: os
    install_method_installer_version: 
    install_method_tool: undefined
    install_method_tool_version: 
=========
Collector
=========
  Error initializing Python
  =========================
    - could not load runtime python for version 3: Unable to open three library: libdatadog-agent-three.so: cannot open shared object file: No such file or directory
  Running Checks
  ==============
    container
    ---------
      Instance ID: container [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/container.d/conf.yaml.default
      Total Runs: 20
      Metric Samples: Last Run: 0, Total: 0
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 4ms
      Last Execution Date : 2022-06-16 23:26:16 CEST / 2022-06-16 21:26:16 UTC (1852367040)
      Last Successful Execution Date : 2022-06-16 23:26:16 CEST / 2022-06-16 21:26:16 UTC (1852367040)
    containerd
    ----------
      Instance ID: containerd [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/containerd.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 0, Total: 0
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 1ms
      Last Execution Date : 2022-06-16 23:26:08 CEST / 2022-06-16 21:26:08 UTC (1852359040)
      Last Successful Execution Date : 2022-06-16 23:26:08 CEST / 2022-06-16 21:26:08 UTC (1852359040)
    cpu
    ---
      Instance ID: cpu [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/cpu.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 9, Total: 164
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2022-06-16 23:26:15 CEST / 2022-06-16 21:26:15 UTC (1852366040)
      Last Successful Execution Date : 2022-06-16 23:26:15 CEST / 2022-06-16 21:26:15 UTC (1852366040)
    docker
    ------
      Instance ID: docker [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/docker.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 9, Total: 171
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 1, Total: 19
      Average Execution Time : 96ms
      Last Execution Date : 2022-06-16 23:26:07 CEST / 2022-06-16 21:26:07 UTC (1852358040)
      Last Successful Execution Date : 2022-06-16 23:26:07 CEST / 2022-06-16 21:26:07 UTC (1852358040)
    file_handle
    -----------
      Instance ID: file_handle [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/file_handle.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 5, Total: 95
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2022-06-16 23:26:14 CEST / 2022-06-16 21:26:14 UTC (1852365040)
      Last Successful Execution Date : 2022-06-16 23:26:14 CEST / 2022-06-16 21:26:14 UTC (1852365040)
    io
    --
      Instance ID: io [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/io.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 67, Total: 1,228
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 1ms
      Last Execution Date : 2022-06-16 23:26:06 CEST / 2022-06-16 21:26:06 UTC (1852357040)
      Last Successful Execution Date : 2022-06-16 23:26:06 CEST / 2022-06-16 21:26:06 UTC (1852357040)
    load
    ----
      Instance ID: load [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/load.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 6, Total: 114
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2022-06-16 23:26:13 CEST / 2022-06-16 21:26:13 UTC (1852364040)
      Last Successful Execution Date : 2022-06-16 23:26:13 CEST / 2022-06-16 21:26:13 UTC (1852364040)
    memory
    ------
      Instance ID: memory [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/memory.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 20, Total: 380
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2022-06-16 23:26:05 CEST / 2022-06-16 21:26:05 UTC (1852356040)
      Last Successful Execution Date : 2022-06-16 23:26:05 CEST / 2022-06-16 21:26:05 UTC (1852356040)
    ntp
    ---
      Instance ID: ntp:d884b5186b651429 [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/ntp.d/conf.yaml.default
      Total Runs: 1
      Metric Samples: Last Run: 1, Total: 1
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 1, Total: 1
      Average Execution Time : 292ms
      Last Execution Date : 2022-06-16 23:21:31 CEST / 2022-06-16 21:21:31 UTC (1852082040)
      Last Successful Execution Date : 2022-06-16 23:21:31 CEST / 2022-06-16 21:21:31 UTC (1852082040)
    uptime
    ------
      Instance ID: uptime [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/uptime.d/conf.yaml.default
      Total Runs: 19
      Metric Samples: Last Run: 1, Total: 19
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2022-06-16 23:26:12 CEST / 2022-06-16 21:26:12 UTC (1852363040)
      Last Successful Execution Date : 2022-06-16 23:26:12 CEST / 2022-06-16 21:26:12 UTC (1852363040)
  Loading Errors
  ==============
    apm
    ---
      Core Check Loader:
        Check apm not found in Catalog
      JMX Check Loader:
        check is not a jmx check, or unable to determine if it's so
      Python Check Loader:
        python is not initialized
    process_agent
    -------------
      Core Check Loader:
        Check process_agent not found in Catalog
      JMX Check Loader:
        check is not a jmx check, or unable to determine if it's so
      Python Check Loader:
        python is not initialized
    winproc
    -------
      Core Check Loader:
        Check winproc not found in Catalog
      JMX Check Loader:
        check is not a jmx check, or unable to determine if it's so
      Python Check Loader:
        python is not initialized
========
JMXFetch
========
  Information
  ==================
  Initialized checks
  ==================
    no checks
  Failed checks
  =============
    no checks
=========
Forwarder
=========
  Transactions
  ============
    Cluster: 0
    ClusterRole: 0
    ClusterRoleBinding: 0
    CronJob: 0
    DaemonSet: 0
    Deployment: 0
    Dropped: 0
    HighPriorityQueueFull: 0
    Ingress: 0
    Job: 0
    Node: 0
    PersistentVolume: 0
    PersistentVolumeClaim: 0
    Pod: 0
    ReplicaSet: 0
    Requeued: 0
    Retried: 0
    RetryQueueSize: 0
    Role: 0
    RoleBinding: 0
    Service: 0
    ServiceAccount: 0
    StatefulSet: 0
  Transaction Successes
  =====================
    Total number: 40
    Successes By Endpoint:
      check_run_v1: 19
      intake: 2
      series_v1: 19
  On-disk storage
  ===============
    On-disk storage is disabled. Configure `forwarder_storage_max_size_in_bytes` to enable it.
  API Keys status
  ===============
    API key ending with 234c5: API Key valid
==========
Endpoints
==========
  https://app.datadoghq.eu - API Key ending with:
      - 234c5
==========
Logs Agent
==========
  Logs Agent is not running
=============
Process Agent
=============
  Status: Not running or unreachable
=========
APM Agent
=========
  Status: Not running or unreachable on localhost:8126.
  Error: Get "http://localhost:8126/debug/vars": dial tcp [::1]:8126: connect: connection refused
=========
Aggregator
=========
  Checks Metric Sample: 2,556
  Dogstatsd Metric Sample: 1
  Event: 1
  Events Flushed: 1
  Number Of Flushes: 19
  Series Flushed: 2,172
  Service Check: 212
  Service Checks Flushed: 228
=========
DogStatsD
=========
  Event Packets: 0
  Event Parse Errors: 0
  Metric Packets: 0
  Metric Parse Errors: 0
  Service Check Packets: 0
  Service Check Parse Errors: 0
  Udp Bytes: 0
  Udp Packet Reading Errors: 0
  Udp Packets: 0
  Uds Bytes: 0
  Uds Origin Detection Errors: 0
  Uds Packet Reading Errors: 0
  Uds Packets: 0
  Unterminated Metric Errors: 0
====
OTLP
====
  Status: Not enabled
  Collector status: Not running

Describe what happened: Browsing available metrics and can't find any metrics from the disk integration (system.disk.*, system.fs.inodes.*)

Describe what you expected: Metrics such as system.disk.free available

Steps to reproduce the issue:

  1. Compile the agent using instructions found here https://github.com/DataDog/datadog-agent#getting-started
  2. Copy contents of dist to /etc/datadog-agent
  3. Start agent
  4. View metrics in the datadog console

Additional environment details (Operating System, Cloud provider, etc):

gs11 commented 2 years ago

After copying https://github.com/DataDog/datadog-agent/blob/main/cmd/agent/dist/conf.d/disk.d/conf.yaml.default to /etc/datadog-agent/disk.d/conf.yaml it started working. Just strange it is not included by default in the dist