search

centreon / centreon-engine

Extremely fast monitoring scheduler, forked from Nagios
GNU General Public License v2.0
42 stars 17 forks source link

[enhancement] Kind of logs sent to the broker #110

Open jaltmeyer opened 6 years ago

jaltmeyer commented 6 years ago

Hi,

On some big installations, central broker use a lot of resources and is very busy. In order to reduce its load, it would be nice to be able to choose, with a broker module startup option, kind of logs that will be sent to the broker. For example, disable the "system logs" (those visible in the Monitoring > Event Logs > System Logs) on pollers's engine could significantly lighten the the load for the broker.

Now, if we disable the BROKER_LOGGED_DATA (1<<5), not only the system logs are not transmitted, but also the monitoring logs. But we would like to keep monitoring logs.

Regards.

Akatizi commented 5 years ago

Hello,

We are exactly in this case, we have a passive infrastructure, and we receive more than 3 million events per hour! Our Centreon that deals with all these events is the bottleneck. These logs are processed by the broker and that is what makes us the most load! Can you see this point please? Thank you

bouda1 commented 5 years ago

I am going to take a look at this enhancement. Cheers.

Akatizi commented 5 years ago

Oh thanks you :) Cheers

Akatizi commented 5 years ago

Hello @Bouda1, I come back on this point to take news :) Indeed, we manage a consistent CENTREON infrastructure, with 5000 equipment and about 205 000 services. This generates 50GB of log per day, which is huge in terms of capacity :( Thanks you

bouda1 commented 5 years ago

We have made experiments on this improvement but it needs more tests as it can break many things. It should arrive pretty soon, at less I hope. Regards.

Akatizi commented 5 years ago

No problem, Thank you for taking into account the problem :) Regards.