fluent / fluent-plugin-prometheus

A fluent plugin that collects metrics and exposes for Prometheus.
Apache License 2.0
258 stars 79 forks source link

All metric value 0 #193

Open jvs87 opened 2 years ago

jvs87 commented 2 years ago

Hello,

I have configure prometheus to collect metrics, everything its ok but all metrics I get have value 0.

TYPE fluentd_output_status_buffer_total_bytes gauge

HELP fluentd_output_status_buffer_total_bytes Current total size of stage and queue buffers.

fluentd_output_status_buffer_total_bytes{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_buffer_total_bytes{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0

TYPE fluentd_output_status_buffer_stage_length gauge

HELP fluentd_output_status_buffer_stage_length Current length of stage buffers.

fluentd_output_status_buffer_stage_length{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_buffer_stage_length{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0

TYPE fluentd_output_status_buffer_stage_byte_size gauge

HELP fluentd_output_status_buffer_stage_byte_size Current total size of stage buffers.

fluentd_output_status_buffer_stage_byte_size{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_buffer_stage_byte_size{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0

TYPE fluentd_output_status_buffer_queue_length gauge

HELP fluentd_output_status_buffer_queue_length Current length of queue buffers.

fluentd_output_status_buffer_queue_length{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_buffer_queue_length{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0

TYPE fluentd_output_status_queue_byte_size gauge

HELP fluentd_output_status_queue_byte_size Current total size of queue buffers.

fluentd_output_status_queue_byte_size{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_queue_byte_size{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0

TYPE fluentd_output_status_buffer_available_space_ratio gauge

HELP fluentd_output_status_buffer_available_space_ratio Ratio of available space in buffer.

fluentd_output_status_buffer_available_space_ratio{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 100.0 fluentd_output_status_buffer_available_space_ratio{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 100.0

TYPE fluentd_output_status_buffer_newest_timekey gauge

HELP fluentd_output_status_buffer_newest_timekey Newest timekey in buffer.

TYPE fluentd_output_status_buffer_oldest_timekey gauge

HELP fluentd_output_status_buffer_oldest_timekey Oldest timekey in buffer.

TYPE fluentd_output_status_retry_count gauge

HELP fluentd_output_status_retry_count Current retry counts.

fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cce00",type="copy"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_num_errors gauge

HELP fluentd_output_status_num_errors Current number of errors.

fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cce00",type="copy"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_num_errors{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_emit_count gauge

HELP fluentd_output_status_emit_count Current emit counts.

fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cce00",type="copy"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_emit_records gauge

HELP fluentd_output_status_emit_records Current emit records.

fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cce00",type="copy"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_emit_records{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_write_count gauge

HELP fluentd_output_status_write_count Current write counts.

fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_write_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_rollback_count gauge

HELP fluentd_output_status_rollback_count Current rollback counts.

fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_rollback_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_flush_time_count gauge

HELP fluentd_output_status_flush_time_count Total flush time.

fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_flush_time_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_slow_flush_count gauge

HELP fluentd_output_status_slow_flush_count Current slow flush counts.

fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_slow_flush_count{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

TYPE fluentd_output_status_retry_wait gauge

HELP fluentd_output_status_retry_wait Current retry wait

fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8fa223c",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f9e9e8",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec8f80a9c",type="null"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec982e1a8",type="s3"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec975be9c",type="elasticsearch"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec96e9770",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95cb4c4",type="rewrite_tag_filter"} 0.0 fluentd_output_status_retry_wait{hostname="ip-10-159-21-15.eu-west-1.compute.internal",plugin_id="object:2afec95c8080",type="rewrite_tag_filter"} 0.0

Config of the yaml its this :

log_level warn workers 4

<worker 0>

@type http_healthcheck
bind 0.0.0.0
port 8888

@type prometheus
bind 0.0.0.0
port 24231
metrics_path /metrics

@type prometheus_output_monitor
interval 10
<labels>
  hostname ${hostname}
</labels>

Any suggestion ?

Thanks