contribsys / faktory

Language-agnostic persistent background job server
https://contribsys.com/faktory/
Other
5.78k stars 230 forks source link

Faktory server won't start without statsd server #444

Closed alondahari closed 10 months ago

alondahari commented 1 year ago

We have a Faktory pro server deployed on Kubernetes. We configured the server to send statsd metrics to a server in the cluster, but that server failed to start up in our production environment. As a result, the Faktory server failed to start up which led to an outage of our platform until we figured out the issue.

Since sending metrics to statsd is probably not mission critical, it would probably be better to log the issue and continue booting up, instead of a complete failure.

mperham commented 1 year ago

Faktory server failed to start up

Show me the error.

alondahari commented 1 year ago

Sorry for the delay. There's actually no error that I can find, the pod is just going into a podCrashLoopBackOff, saying it's completed with exit code 0.

The logs from the pod: CleanShot 2023-09-27 at 13 37 42

mperham commented 1 year ago

Upgrade and see if that fixes things.

alondahari commented 1 year ago

Looks like the node faktory client is only compatible with 1.6.1, or at least that's what the docs say

mperham commented 1 year ago

I doubt that. If true, I would hope they'd open an issue so we can improve the situation.