Azure / azure-diagnostics-tools

Plugins and tools for collecting, processing, managing, and visualizing diagnostics data and configuration
98 stars 93 forks source link

No data is sent to Elastic search #224

Closed jfalameda closed 3 years ago

jfalameda commented 3 years ago

Hi,

I am having so issues understanding why the data is not reaching Elastic search. It seems like it is a configuration issue and I cannot find any diagnostics documentation.

As far as I can see Logstash is reaching the container (I see a data/registry was created and contains metadata and information about the last poll).

I have been looking at logstash.log (I suppose this is the one I should be looking at) and I cannot find any error information.

[2020-07-23T09:01:01,923][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}

I do not find though any indexes created on ElasticSearch.

This is my pipeline configuration:

input
{
    azureblob
    {
        storage_account_name => "xxxxxxx"
        storage_access_key => "XXXXXX"
        container => "logs"
    codec => "json"
    }
}

output {
    stdout { codec => rubydebug }
    elasticsearch {
    hosts => ["127.0.0.1:9200"]
        index => "%{[assemblyName]}-%{+YYYY.MM}"
    codec => json
    }
}
# curl http://localhost:9200/_aliases?pretty=true
{
  ".kibana_1" : {
    "aliases" : {
      ".kibana" : { }
    }
  }
}

I would appreciate some help understanding if the problem lives on the logstash plugin or somewhere else.

Thanks, José.