search

tsaikd / gogstash

Logstash like, written in golang
MIT License
644 stars 106 forks source link

Add input redis batch method #55

Closed tengattack closed 6 years ago

tengattack commented 6 years ago

Redis single BLPOP is too slow for great numbers of data

Reference: https://github.com/logstash-plugins/logstash-input-redis/blob/809495173b57f2864f9d19b027a9cb7a76a7aac4/lib/logstash/inputs/redis.rb#L208-L244

In real, it can bring us ~3x speed than before.