logsearch / logsearch-boshrelease

A BOSH-scalable Elasticsearch+Logstash+Kibana release
http://www.logsearch.io
Apache License 2.0
57 stars 46 forks source link

Collectd and ES as metrics collector and db #81

Closed shinji62 closed 10 years ago

shinji62 commented 10 years ago

Hi,

Logsearch package for CF is really good, I want to extend it. So I am thinking about making collectd to be able to send to an collectd ingestor and by this way put metrics we need into Elastisearch (cpu, mem, network).

Do you think is reasonable ?

Thanks

dpb587 commented 10 years ago

Hi - thanks for the comment. You may be interested in our logsearch-shipper release. It is intended to be installed on jobs and can forward both logs and metrics to a regular logsearch deployment. By default, it runs collectd and forwards cpu/mem/network/other host stats which you can view in Kibana (example screenshot). We also use it to forward deployment-specific metrics, like logsearch performance stats (example screenshot). More details are in the repo's readme.

Does this seem like what you are looking for?

shinji62 commented 10 years ago

yes, the only things is you cannot separate collectd from the nxlog package. It can be nice to make to different job and it's more flexible.

anyway thanks