Open jjbuchan opened 3 years ago
When flume was first deployed we could handle 2.5M metrics/minute per node.
If the time comes where we need to increase this throughput, we have a few options that should most likely be followed in this order.
run
-Xmx12G
byteCapacity
-Xmx
The Flume User Guide is a good place to start reading about these options - https://flume.apache.org/FlumeUserGuide.html
When flume was first deployed we could handle 2.5M metrics/minute per node.
If the time comes where we need to increase this throughput, we have a few options that should most likely be followed in this order.
run
file-Xmx12G
is setbyteCapacity
for the memory channel defaults at 80% of the-Xmx
value.The Flume User Guide is a good place to start reading about these options - https://flume.apache.org/FlumeUserGuide.html