grafana / pyroscope-java

pyroscope java integration
Apache License 2.0
72 stars 31 forks source link

Error uploading snapshot leading to Honeycomb queue overflow #72

Open taliatrilling opened 1 year ago

taliatrilling commented 1 year ago

Hi, when our Pyroscope server reaches a certain level of load, we see the following message spammed in logs:

[ERROR] Error uploading snapshot: flamingo-pyroscope-server.production.local: Name or service not known"}

This message is then followed by:

Client rejected Honeycomb event. Reason: QUEUE_OVERFLOW. Event metadata: {}

in our logs, which we have only ever seen while Pyroscope is enabled. To be clear, we do initially see profiling data come out of Pyroscope when we enable it, even though the message would imply otherwise.

Pyroscope extension version: 0.10.1.4 Pyroscope server version: 0.29.0