hartfordfive / protologbeat

Application accepting log data via TCP or UDP to then index the data in Elasticsearch
Other
27 stars 14 forks source link

Allow multiple json messages per TCP stream #19

Open RichardHeelin opened 6 years ago

RichardHeelin commented 6 years ago

We wanted to use TCP to stream all our log messages in one connection to reduce the overhead on our application, however protologbeat only handles the first message by default. By wrapping the Unmarshal call in a bufio.Scanner we can parse one json message per line, allowing for an unlimited number of logs to be sent in one TCP stream.

This should also resolve issue #15, assuming they want to use json as the message format.