search

vmware-archive / pcf-prometheus-pipeline

Apache License 2.0
20 stars 38 forks source link

Bosh Exporter CPU / Task intensive #2

Open shinji62 opened 6 years ago

shinji62 commented 6 years ago

Maybe a good idea to add an information about using Bosh exporter in large deployment / many tiles env.

As my experience with the Bosh exporter, depending on the scrape config, it could lead to consume the bosh director CPU and as the director create a million of queue task.

This will in some case block the release process as bosh will wait to finish the queued task.

benjaminguttmann-avtq commented 5 years ago

In such cases it makes sense to switch from bosh exporter to use the BOSH TSDB exporter. In that case the Director gets configured in such a way that the healthmanager sends data to the exporter instead of the exporter creating BOSH tasks. Unfortunately, you would loose some information while switching. You should be able to get a more detailed overview about this topic here.

In addition, I am not sure if it is easily possible to switch from bosh exporter to BOSH TSDB exporter by using pcf prometheus pipeline.