eBayClassifiedsGroup / PanteraS

PanteraS - PaaS - Platform as a Service in a box
GNU General Public License v2.0
200 stars 61 forks source link

[feedback] Chronos/Netdata #283

Closed kopax closed 6 years ago

kopax commented 6 years ago

Hi panteras users,

@cookandy , I have a question regarding netdata, how do you found it for monitoring and logging ? The leading docker monitoring opensource service has changed.

In a much more advanced state than netdata, should we consider renewing these tools?

Also, I have found Chronos as a complicated/unfinished/heavy scheduling tool, we by default decided to stop using it because of it's reliability.

Are you people using it? I am using classic crontab for scheduling but this require SSHing to the server for editing the crontab.

cookandy commented 6 years ago

I must admit I haven't used netdata in quite some time. Most of my production servers are monitored by Scout and other monitoring tools. The container metrics are either written to statsd or grabbed by prometheus.

With regards to Chronos, I've also found it quite buggy and usually just use cron as well.

sielaq commented 6 years ago

We use Graphite or Prometheus and for viewing Grafana. Netdata is by default disabled.

Regarding Chronos - we use it occasionally (one usecase)

kopax commented 6 years ago

Hi and Happy new years! As @sielaq use Grafana and @cookandy doesn't use it anymore:

Also, I'd like to ask you both about data persistence accross cluster. So far An app with data must be started with only one instance and using fixed hostname when starting the container in marathon.

sielaq commented 6 years ago

should I consider removing netdata and install grafana instead in the Dockerfile?

you don't have to start netdata. its the same with 100s of other apps you have in the image but you don use them. Moreover installing grafana will not help you much - you need a source of data (graphite/prometheus...) for that you have different project - don't try to put all the apps into one container -not worth to.

Is there any driver I should use with marathon ?

How to combine Docker/Mesos/Marathon with Grafana+graphite: you can use collectd: https://github.com/bogus-py/docker-collectd-plugin (for docker vs marathon match) https://github.com/rayrod2030/collectd-mesos (for mesos statistics ) etc.. and use build in write_graphite plugin

If you want to get metrics from application (service related) you can do in 2 ways: push or pull:

If you choose prometheus you can use lots of exportres https://prometheus.io/docs/instrumenting/exporters/

so, no adding more stuff to PanteraS is needed - just use additional projects and integrate them as you wish.

kopax commented 6 years ago

so, no adding more stuff to PanteraS is needed - just use additional projects and integrate them as you wish.

Ok. I will close this then.

I've just read the overview of prometheus and it look promising. I think I've read gitlab support metrics integration from prometheus. How do you use the exporteds metrics ? Is it grafana job ?

sielaq commented 6 years ago

grafana is only for drawing / plotting / alerting based on multiple sources of data the data source can be: Graphite, Prometheus, Influx etc... you can use collectd (for graphite) or prometheus exporters (for prometheus)