search

wehkamp / docker-prometheus-cloudflare-exporter

Cloudflare exporter for Prometheus
Apache License 2.0
75 stars 25 forks source link

WAF event scraping limited #8

Open harmw opened 7 years ago

harmw commented 7 years ago

Due to timing limitations, combined with a fixed limit of 50 events per request the current implementation will stop processing these events if it takes > 55s. This will cause the end-result to be somewhat of in these cases, but at least we're getting some data.

INFO:root:WAF events found: 4550 (took 55.5084469318 seconds)

Alternative solution would be dropping the spikes, but that way we're even more clueless on what happens.

Let's hope Cloudflare can change their endpoint to allow consuming more data.

Would be nice to look into adding support for Keep-Alive, that'll at least take care of the expensive SSL handshakes.

harmw commented 6 years ago

Just pushed https://github.com/wehkamp/docker-prometheus-cloudflare-exporter/commit/4a3fbe98497ae8a11f785ca5a07a766507a0f348 to circumvent the annoyances (by literally disabling scraping WAF data)