search

fangli / fluent-plugin-influxdb

A buffered output plugin for fluentd and InfluxDB
MIT License
111 stars 65 forks source link

memory leak if influxdb goes down #97

Open tsorya opened 5 years ago

tsorya commented 5 years ago

We are running influxdb plugin with config: <match metrics.*> @type influxdb host 10.47.246.7 port 8086 dbname test use_ssl false time_key time auto_tags time_precision ms retry 3

@type memory # chunk_limit_size 524288 # 512 * 1024 # chunk_limit_records 1024 flush_interval 10 retry_limit 3 retry_wait 1.0 num_threads 1 json

when we stop influxdb we see that fluentd is leaking memory: Screenshot from 2019-07-04 14-12-50

any ideas?

repeatedly commented 5 years ago

Use file buffer instead :) This is not memory leak because you use memory buffer. It stores data in memory so this is expected behaviour.

tsorya commented 5 years ago

@repeatedly why it doesn't drop them after finishing retrying?

repeatedly commented 5 years ago

why it doesn't drop them after finishing retrying?

Your log doesn't contain any retry / drop information?