search

patant / fluent-plugin-loggly

Fluentd plugin for output to loggly
Apache License 2.0
13 stars 24 forks source link

200 Success responses, but no data appears in Loggly dashboard #25

Open jdrago999 opened 7 years ago

jdrago999 commented 7 years ago

200 Success responses, but no data appears in Loggly dashboard:

screen shot 2017-07-12 at 12 35 57 am

screen shot 2017-07-12 at 12 49 06 am

Same data, same everything -- showed up instantly in Logz.io dashboard:

screen shot 2017-07-12 at 12 46 38 am

njam commented 7 years ago

In your Loggly screenshot the search is still ongoing (there's a spinner) - are you sure the search finished and the data didn't show up?

Are you able to send events to Loggly using curl? And what is your fluentd config?

edify42 commented 7 years ago

I had the same issue running ruby 2.2.5p319 and fluent-plugin-loggly-0.0.8 with the configuration below

<match **>
    @type loggly_buffered
    loggly_url https://logs-01.loggly.com/bulk/UUID/tag/tag1,tag2
    output_include_time true
    buffer_type memory
    flush_interval 1s
</match>

I had to revert back to non-buffered type and this worked for us:

<match **>
    @type loggly
    loggly_url https://logs-01.loggly.com/inputs/UUID/tag/tag1,tag2
</match>
patant commented 7 years ago

What´s your environment setup?

edify42 commented 7 years ago

Kubernetes 1.5.6 cluster Debian Jessie 8.6 (kernel 4.4.41-k8s) Docker Server Version: 1.12.3 Running on AWS

edify42 commented 7 years ago

Some output from the fluentd logs:

2017-09-04 10:50:58 +1000 daemon.info: {"host":"sample-service-95366385-664ex","ident":"unicorn","message":"I, [2017-09-04T10:50:58.184083 #326] INFO -- : Completed 200 OK in 79ms (Views: 4.0ms | ActiveRecord: 52.3ms)"} 2017-09-04 10:50:58 +1000 nginx.info: {"remote":"100.66.53.3","host":"-","user":"-","method":"GET","path":"/v1/newsletters?active=true&publication_acronym=AGE","code":"200","size":"16172","referer":"-","agent":"Faraday v0.11.0","progname":"nginx"} 2017-09-04 10:50:58 +1000 daemon.info: {"host":"sample-service-95366385-664ex","ident":"unicorn","message":"203.26.51.2, 10.124.48.26, 100.66.53.3 - - [04/Sep/2017:10:50:58 +1000] \"GET /v1/newsletters?active=true&publication_acronym=AGE HTTP/1.0\" 200 - 0.0829"} 2017-09-04 10:50:58 +1000 [debug]: plugin/out_loggly_buffered.rb:65:write: 39 records sent 2017-09-04 10:51:00 +1000 [debug]: plugin/out_loggly_buffered.rb:70:write: HTTP Response code 200

patant commented 7 years ago

@edify42 Use the lastest version the plugin 0.0.9. Can't see why it's not working. Provide the docker image if you need more help.