danihodovic / celery-exporter

A Prometheus exporter for Celery metrics
MIT License
409 stars 90 forks source link

helm installation with sentinel cluster and broker-transport-option #234

Open adursun1606 opened 1 year ago

adursun1606 commented 1 year ago

Hello. I am gonna deploy celery-exporter by using helm. I have 3 nodes redis sentinel cluster. So how can apply CE_BROKER_URL for sentinel cluster, for one redis I just give the one IP but here no idea and also how can I apply "broker-transport-option master_name=my_master" for example. By using docker commands I can do it but how can apply these values with helm installation. For example should I use CE_BROKER_TRANSPORT_OPTION as an env in values yaml?

danihodovic commented 1 year ago

@adinhodovic helm expert

ClementGautier commented 1 year ago

Hi there 👋 I am trying to do the same thing but can't make it work. I used this values:

    env:
    - name: CE_BROKER_URL
      value: sentinel://redis-node-0.redis-headless.redis.svc.cluster.local:26379/0;sentinel://redis-node-1.redis-headless.redis.svc.cluster.local:26379/0;sentinel://redis-node-2.redis-headless.redis.svc.cluster.local:26379/0
    - name: CE_BROKER_TRANSPORT_OPTION
      value: 'master_name=default-master'
    - name: CE_LOG_LEVEL
      value: DEBUG

The config looks good, the exporter start as expected, cf the logs:

2023-05-31 14:15:34.116 | DEBUG    | src.exporter:run:255 - Setting celery broker_transport_option master_name=default-master
2023-05-31 14:15:34.138 | INFO     | src.http_server:start_http_server:66 - Started celery-exporter at host='0.0.0.0' on port='9808'

But I get no metrics exported on /metrics compared when I use the following (I deployed a small haproxy that target the redis leader)

    env:
    - name: CE_BROKER_URL
      value: redis://haproxy.redis.svc.cluster.local:6379/0

At this point I don't really know how to dig the issue, if someone have any idea I'm all ears

gabohc commented 4 months ago

Using the redis-sentinel bitnami chart, for me the following worked:

env:
- name: CE_BROKER_URL
  value: "sentinel://redis-sentinel.web.svc.cluster.local:26379"
- name: CE_BROKER_TRANSPORT_OPTION
  value: "master_name=redis-master"

I am able to see the metrics through the Grafana dashboards

sebglon commented 3 weeks ago

Work well with version 0.10.10 but not 0.10.7