search

redhat-aqe / kafka-logging-handler

Python Logging Handler for Kafka
GNU General Public License v3.0
27 stars 16 forks source link

Performance degradation (spikes) during flush invocation #19

Open alexkon opened 4 years ago

alexkon commented 4 years ago

image

Hi, guys! Thank you for this library 🙏 We use it to handle log requests and responses in our REST service. It works fine with a small load 👍 But when we have a heavy load it has big latency spikes (every 5 sec) for our REST service. I suppose it happens because flush method works in main process. Could you please give advice about how we could eliminate such performance degradation spikes? Maybe we should move log invocation to a separate process or something like that?

erfan-mehraban commented 3 years ago

According to this line this package doesn't flush on main thread.