logstash-plugins / logstash-output-datadog_metrics

Apache License 2.0
3 stars 18 forks source link

Is this plugin EOL? Working for anyone? #16

Open windowsrefund opened 4 years ago

windowsrefund commented 4 years ago

Running Logstash 7.8.0 with version 3.0.4 of this plugin. I see my events being queued but they're not showing up on the DD side of things. I am aware of the fact this plugin uses the legacy API endpoint but that still works in curl tests I've run outside Logstash itself.

Given the number of PRs I see in limbo along with the curious behavior I'm seeing, I wonder if this plugin is still working for anyone? Right now, I have a very simple configuration:

output {
      datadog_metrics {
        api_key => "MY_KEY"
        metric_name => "logstash.lag_in_seconds"
        metric_value => "%{lag_in_seconds}"
        metric_type => "counter"
      }
    }

Again, I see Logstash queuing the events. In the example below, we can see %{lag_in_seconds} has been correctly evaluated as 0.622

Jul 29 03:20:41 panda.mybox logstash[4463]: [2020-07-29T03:20:41,454][INFO ][logstash.outputs.datadogmetrics][datadog][4a6f5a52754d07a1a678fd1244a5cafafdf74d18083e0f0a708c1ed42b3ac669] Queueing event {:event=>{"metric"=>"logstash.lag_in_seconds", "points"=>[[1595992838, 0.622]], "type"=>"counter", "host"=>"{\"hostname\":\"panda.mybox\",\"os\":{\"name\":\"CentOS Linux\",\"family\":\"redhat\",\"version\":\"7 (Core)\",\"platform\":\"centos\",\"kernel\":\"3.10.0-1127.10.1.el7.x86_64\",\"codename\":\"Core\"},\"ip\":[\"172.31.17.170\",\"2600:1f16:fb6:4403:a929:b736:5388:e370\",\"fe80::c:c7ff:fe2f:260a\"],\"containerized\":false,\"name\":\"panda.mybox\",\"id\":\"f9afeb75a5a382dce8269887a67fbf58\",\"mac\":[\"02:0c:c7:2f:26:0a\"],\"architecture\":\"x86_64\"}", "device"=>"%{metric_device}", "tags"=>["beats_input_codec_plain_applied", "calculated_lag"]}}

I have verified this plugin is generating a valid epoch timestamp (1595992838 from above log entry).

Additionally, I see Logstash is getting 202s back for each POST to DD's API

Jul 29 03:26:29 panda.mybox logstash[4463]: [2020-07-29T03:26:29,387][INFO ][logstash.outputs.datadogmetrics][datadog] DD convo {:request=>"#<Net::HTTP::Post POST>", :response=>"#<Net::HTTPAccepted 202 Accepted readbody=true>"}

Despite all this, I don't see the metric listed in DD's Metric Explorer or Summary.