search

DataDog / integrations-core

Core integrations of the Datadog Agent
BSD 3-Clause "New" or "Revised" License
932 stars 1.4k forks source link

[INFO] Cannot access WAL log directory: pg_wal. #13645

Closed ArturiaPendragon closed 1 year ago

ArturiaPendragon commented 1 year ago

Note: If you have a feature request, you should contact support so the request can be properly tracked.

Output of the info page

===============
Agent (v7.39.2)
===============

  Status date: 2023-01-06 17:02:05.481 CET / 2023-01-06 16:02:05.481 UTC (1673020925481)
  Agent start: 2023-01-06 16:28:01.751 CET / 2023-01-06 15:28:01.751 UTC (1673018881751)
  Pid: 21960
  Go Version: go1.17.11
  Python Version: 3.8.14
  Build arch: amd64
  Agent flavor: agent
  Check Runners: 4
  Log Level: info

  Paths
  =====
    Config File: /etc/datadog-agent/datadog.yaml
    conf.d: /etc/datadog-agent/conf.d
    checks.d: /etc/datadog-agent/checks.d

  Clocks
  ======
    System time: 2023-01-06 17:02:05.481 CET / 2023-01-06 16:02:05.481 UTC (1673020925481)

  Host Info
  =========
    bootTime: 2022-08-04 15:45:08 CEST / 2022-08-04 13:45:08 UTC (1659620708000)
    hostId: 07e7177a-aee1-48bb-80e6-513a7627f58d
    kernelArch: x86_64
    kernelVersion: 3.10.0-1160.71.1.el7.x86_64
    os: linux
    platform: centos
    platformFamily: rhel
    platformVersion: 7.9.2009
    procs: 1300
    uptime: 3721h43m7s

  Hostnames
  =========
    hostname: PRE-APP-SQL-01
    socket-fqdn: PRE-APP-SQL-01.cnb-prive.net.
    socket-hostname: PRE-APP-SQL-01
    host tags:
      availability-zone:eu-west
      cluster:cnb
      country:france
      env:preprod
    hostname provider: os
    unused hostname providers:
      'hostname' configuration/environment: hostname is empty
      'hostname_file' configuration/environment: 'hostname_file' configuration is not enabled
      aws: not retrieving hostname from AWS: the host is not an ECS instance and other providers already retrieve non-default hostnames
      azure: azure_hostname_style is set to 'os'
      container: the agent is not containerized
      fargate: agent is not runnning on Fargate
      fqdn: 'hostname_fqdn' configuration is not enabled
      gce: unable to retrieve hostname from GCE: GCE metadata API error: Get "http://169.254.169.254/computeMetadata/v1/instance/hostname": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

  Metadata
  ========
    agent_version: 7.39.2
    config_apm_dd_url:
    config_dd_url:
    config_logs_dd_url:
    config_logs_socks5_proxy_address:
    config_no_proxy: []
    config_process_dd_url:
    config_proxy_http:
    config_proxy_https:
    config_site:
    feature_apm_enabled: true
    feature_cspm_enabled: false
    feature_cws_enabled: false
    feature_logs_enabled: true
    feature_networks_enabled: false
    feature_networks_http_enabled: false
    feature_networks_https_enabled: false
    feature_otlp_enabled: false
    feature_process_enabled: false
    feature_processes_container_enabled: true
    flavor: agent
    hostname_source: os
    install_method_installer_version: install_script-1.9.0
    install_method_tool: install_script
    install_method_tool_version: install_script
    logs_transport: HTTP

=========
Collector
=========

  Running Checks
  ==============

    cpu
    ---
      Instance ID: cpu [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/cpu.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 9, Total: 1,217
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2023-01-06 17:01:56 CET / 2023-01-06 16:01:56 UTC (1673020916000)
      Last Successful Execution Date : 2023-01-06 17:01:56 CET / 2023-01-06 16:01:56 UTC (1673020916000)

    disk (4.7.1)
    ------------
      Instance ID: disk:e5dffb8bef24336f [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/disk.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 208, Total: 28,936
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 15ms
      Last Execution Date : 2023-01-06 17:02:03 CET / 2023-01-06 16:02:03 UTC (1673020923000)
      Last Successful Execution Date : 2023-01-06 17:02:03 CET / 2023-01-06 16:02:03 UTC (1673020923000)

    file_handle
    -----------
      Instance ID: file_handle [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/file_handle.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 5, Total: 680
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2023-01-06 17:01:55 CET / 2023-01-06 16:01:55 UTC (1673020915000)
      Last Successful Execution Date : 2023-01-06 17:01:55 CET / 2023-01-06 16:01:55 UTC (1673020915000)

    io
    --
      Instance ID: io [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/io.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 275, Total: 37,211
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 1ms
      Last Execution Date : 2023-01-06 17:02:02 CET / 2023-01-06 16:02:02 UTC (1673020922000)
      Last Successful Execution Date : 2023-01-06 17:02:02 CET / 2023-01-06 16:02:02 UTC (1673020922000)

    load
    ----
      Instance ID: load [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/load.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 6, Total: 816
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2023-01-06 17:01:54 CET / 2023-01-06 16:01:54 UTC (1673020914000)
      Last Successful Execution Date : 2023-01-06 17:01:54 CET / 2023-01-06 16:01:54 UTC (1673020914000)

    memory
    ------
      Instance ID: memory [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/memory.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 20, Total: 2,720
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2023-01-06 17:02:01 CET / 2023-01-06 16:02:01 UTC (1673020921000)
      Last Successful Execution Date : 2023-01-06 17:02:01 CET / 2023-01-06 16:02:01 UTC (1673020921000)

    network (2.8.0)
    ---------------
      Instance ID: network:d884b5186b651429 [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/network.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 86, Total: 11,696
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 2ms
      Last Execution Date : 2023-01-06 17:01:53 CET / 2023-01-06 16:01:53 UTC (1673020913000)
      Last Successful Execution Date : 2023-01-06 17:01:53 CET / 2023-01-06 16:01:53 UTC (1673020913000)

    ntp
    ---
      Instance ID: ntp:d884b5186b651429 [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/ntp.d/conf.yaml.default
      Total Runs: 3
      Metric Samples: Last Run: 0, Total: 0
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 1, Total: 3
      Average Execution Time : 20.135s
      Last Execution Date : 2023-01-06 16:58:27 CET / 2023-01-06 15:58:27 UTC (1673020707000)
      Last Successful Execution Date : 2023-01-06 16:58:27 CET / 2023-01-06 15:58:27 UTC (1673020707000)

    postgres (12.5.1)
    -----------------
      Instance ID: postgres:e8f2650c8eb248c [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/postgres.d/conf.yaml
      Total Runs: 137
      Metric Samples: Last Run: 159, Total: 21,385
      Events: Last Run: 0, Total: 0
      Database Monitoring Activity Samples: Last Run: 2, Total: 200
      Database Monitoring Query Metrics: Last Run: 1, Total: 201
      Database Monitoring Query Samples: Last Run: 1, Total: 92
      Service Checks: Last Run: 1, Total: 137
      Average Execution Time : 30ms
      Last Execution Date : 2023-01-06 17:02:04 CET / 2023-01-06 16:02:04 UTC (1673020924000)
      Last Successful Execution Date : 2023-01-06 17:02:04 CET / 2023-01-06 16:02:04 UTC (1673020924000)
      metadata:
        version.major: 11
        version.minor: 15
        version.patch: 0
        version.raw: 11.15
        version.scheme: semver

    uptime
    ------
      Instance ID: uptime [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/uptime.d/conf.yaml.default
      Total Runs: 136
      Metric Samples: Last Run: 1, Total: 136
      Events: Last Run: 0, Total: 0
      Service Checks: Last Run: 0, Total: 0
      Average Execution Time : 0s
      Last Execution Date : 2023-01-06 17:02:00 CET / 2023-01-06 16:02:00 UTC (1673020920000)
      Last Successful Execution Date : 2023-01-06 17:02:00 CET / 2023-01-06 16:02:00 UTC (1673020920000)

========
JMXFetch
========

  Information
  ==================
  Initialized checks
  ==================
    no checks

  Failed checks
  =============
    no checks

=========
Forwarder
=========

  Transactions
  ============
    Cluster: 0
    ClusterRole: 0
    ClusterRoleBinding: 0
    CronJob: 0
    DaemonSet: 0
    Deployment: 0
    Dropped: 0
    HighPriorityQueueFull: 0
    Ingress: 0
    Job: 0
    Node: 0
    PersistentVolume: 0
    PersistentVolumeClaim: 0
    Pod: 0
    ReplicaSet: 0
    Requeued: 2
    Retried: 2
    RetryQueueSize: 0
    Role: 0
    RoleBinding: 0
    Service: 0
    ServiceAccount: 0
    StatefulSet: 0

  Transaction Successes
  =====================
    Total number: 287
    Successes By Endpoint:
      check_run_v1: 136
      intake: 12
      metadata_v1: 3
      series_v1: 136

  Transaction Errors
  ==================
    Total number: 1
    Errors By Type:

  On-disk storage
  ===============
    On-disk storage is disabled. Configure `forwarder_storage_max_size_in_bytes` to enable it.

  API Keys status
  ===============
    API key ending with c598c: API Key valid

==========
Endpoints
==========
  https://app.datadoghq.com - API Key ending with:
      - c598c

==========
Logs Agent
==========
    Reliable: Sending compressed logs in HTTPS to agent-http-intake.logs.datadoghq.com on port 443
    BytesSent: 1.52590397e+08
    EncodedBytesSent: 5.339439e+06
    LogsProcessed: 420332
    LogsSent: 420825

  postgres
  --------
    - Type: file
      Path: /pglogs/postgresql-*.log
      Service: ebarreau-v2
      Source: postgresql
      Status: OK
        6 files tailed out of 6 files matching
      Inputs:
        /pglogs/postgresql-20230106.log
        /pglogs/postgresql-20230105.log
        /pglogs/postgresql-20230104.log
        /pglogs/postgresql-20230103.log
        /pglogs/postgresql-20230102.log
        /pglogs/postgresql-20230101.log
      BytesRead: 6.9283073e+07
      Average Latency (ms): 0
      24h Average Latency (ms): 0
      Peak Latency (ms): 10
      24h Peak Latency (ms): 10
      Lines Combined: 0
      MultiLine matches: 420332

=============
Process Agent
=============

  Version: 7.39.2
  Status date: 2023-01-06 17:02:19.2 CET / 2023-01-06 16:02:19.2 UTC (1673020939200)
  Process Agent Start: 2023-01-06 16:28:01.813 CET / 2023-01-06 15:28:01.813 UTC (1673018881813)
  Pid: 21962
  Go Version: go1.17.11
  Build arch: amd64
  Log Level: info
  Enabled Checks: [process_discovery]
  Allocated Memory: 12,193,744 bytes
  Hostname: PRE-APP-SQL-01

  =================
  Process Endpoints
  =================
    https://process.datadoghq.com - API Key ending with:
        - c598c

  =========
  Collector
  =========
    Last collection time: 2023-01-06 16:28:03
    Docker socket:
    Number of processes: 0
    Number of containers: 0
    Process Queue length: 0
    RTProcess Queue length: 0
    Connections Queue length: 0
    Event Queue length: 0
    Pod Queue length: 0
    Process Bytes enqueued: 0
    RTProcess Bytes enqueued: 0
    Connections Bytes enqueued: 0
    Event Bytes enqueued: 0
    Pod Bytes enqueued: 0
    Drop Check Payloads: []

=========
APM Agent
=========
  Status: Running
  Pid: 21961
  Uptime: 2057 seconds
  Mem alloc: 8,921,208 bytes
  Hostname: PRE-APP-SQL-01
  Receiver: localhost:8126
  Endpoints:
    https://trace.agent.datadoghq.com

  Receiver (previous minute)
  ==========================
    No traces received in the previous minute.

  Writer (previous minute)
  ========================
    Traces: 0 payloads, 0 traces, 0 events, 0 bytes
    Stats: 0 payloads, 0 stats buckets, 0 bytes

==========
Aggregator
==========
  Checks Metric Sample: 107,260
  Dogstatsd Metric Sample: 21,721
  Event: 1
  Events Flushed: 1
  Number Of Flushes: 136
  Series Flushed: 102,924
  Service Check: 1,368
  Service Checks Flushed: 1,501
  Database Monitoring Activity Samples: 200
  Database Monitoring Query Metrics: 201
  Database Monitoring Query Samples: 92

=========
DogStatsD
=========
  Event Packets: 0
  Event Parse Errors: 0
  Metric Packets: 21,720
  Metric Parse Errors: 0
  Service Check Packets: 0
  Service Check Parse Errors: 0
  Udp Bytes: 1,944,581
  Udp Packet Reading Errors: 0
  Udp Packets: 12,436
  Uds Bytes: 0
  Uds Origin Detection Errors: 0
  Uds Packet Reading Errors: 0
  Uds Packets: 0
  Unterminated Metric Errors: 0

====
OTLP
====

  Status: Not enabled
  Collector status: Not running

Additional environment details (Operating System, Cloud provider, etc): Operating System: CentOS Linux 7 (Core) Kernel: Linux 3.10.0-1160.71.1.el7.x86_64 Architecture: x86-64 psql (PostgreSQL) 11.15

Permissions : drwx------. 3 postgres postgres 204800 Jan 6 16:46 pg_wal

Describe the results you received:

Jan 06 17:11:34 SQL-01 agent[21960]: 2023-01-06 17:11:34 CET | CORE | WARN | (pkg/collector/python/datadog_agent.go:125 in LogMessage) | postgres:e8f2650c8eb248c | (postgres.py:123) | Cannot access WAL log directory: /pgdata/pg_wal. Ensure that you are running the agent on your local postgres database.

Describe the results you expected:

No Warn?

Additional information you deem important (e.g. issue happens only occasionally):

justiniso commented 1 year ago

Hi @ArturiaPendragon can you please submit a support ticket so we can take a look in more detail? Thank you 🙇