certtools / intelmq

IntelMQ is a solution for IT security teams for collecting and processing security feeds using a message queuing protocol.
https://docs.intelmq.org/latest/
GNU Affero General Public License v3.0
977 stars 296 forks source link

ENH: idea - keep event rate (events/sec) in bot and show in intelmq-manager #361

Open aaronkaplan opened 9 years ago

aaronkaplan commented 9 years ago

While observing intelmq-manager and monitoring the throughput of different bots, I noticed that you can only get a snapshot in time of the queue length. However, the snapshot really depends on the processing speed of the bot and when the snapshot is done. This does not tell you very well, how fast a bot is processing data. Therefore, I'd like to propose that each bot keeps an internal counter for an event rate (events/sec) and that it exposes that info to intelmq-manager.

sebix commented 8 years ago

We had the idea to save such statistical data and status information in redis as simple keys. The bot writes his data there after one process()-call.