search

balabit / syslog-ng-incubator

Experimental modules for syslog-ng 3.5+
Other
52 stars 28 forks source link

kafka: check for partition availability before selecting one #110

Closed vincentbernat closed 9 years ago

vincentbernat commented 9 years ago

When a partition is unavailable, sending to it will just lead to a lost log. Therefore, after selecting the partition, check if it is available. If not, select the next one until we tried them all.

A future iteration may use consistent hashing to avoid to double the work done on a partition when the previous one is unavailable.

pyr commented 9 years ago

LGTM, +1 !

lbudai commented 9 years ago

Thanks!