contribsys / faktory

Language-agnostic persistent background job server
https://contribsys.com/faktory/
Other
5.66k stars 226 forks source link

Faktory server won't start without statsd server #444

Closed alondahari closed 5 months ago

alondahari commented 10 months ago

We have a Faktory pro server deployed on Kubernetes. We configured the server to send statsd metrics to a server in the cluster, but that server failed to start up in our production environment. As a result, the Faktory server failed to start up which led to an outage of our platform until we figured out the issue.

Since sending metrics to statsd is probably not mission critical, it would probably be better to log the issue and continue booting up, instead of a complete failure.

mperham commented 10 months ago

Faktory server failed to start up

Show me the error.

alondahari commented 9 months ago

Sorry for the delay. There's actually no error that I can find, the pod is just going into a podCrashLoopBackOff, saying it's completed with exit code 0.

The logs from the pod: CleanShot 2023-09-27 at 13 37 42

mperham commented 9 months ago

Upgrade and see if that fixes things.

alondahari commented 9 months ago

Looks like the node faktory client is only compatible with 1.6.1, or at least that's what the docs say

mperham commented 9 months ago

I doubt that. If true, I would hope they'd open an issue so we can improve the situation.