Improve flow export to mitigate export bursts

ntop / n2disk

Open source components and extensions for n2disk

498 stars 11 forks source link

Improve flow export to mitigate export bursts #32

Open cardigliano opened 3 years ago

cardigliano commented 3 years ago

n2disk computes flows by scanning files as soon se they are ready in memory, this creates bursts in exported flows when the file size is high and there are many flows. This should be improved to avoid message loss on the collector.

cardigliano commented 2 years ago

ZMQ export now relies on ZMQ support in PF_RING FT. ZMQ export in PF_RING FT has been implemented using an export queue with an algorithm that mitigates export bursts.