Closed ahdinosaur closed 6 years ago
i guess i have no idea what the actual uptime on these servers are, i'm only making shit up. should probably setup a monitor that checks for actual ssb availability. 😄
this keeps happening, especially on the pub with the most load. going to try using dumb-init to see if that will fix the problem, where the hypothesis is that the node process is becoming defunkt and docker doesn't realize it needs to restart.
this is fixed with e2d2c7775a456661764f8325dcb2badbd98f9d28, b0034a37f00e90ab9dc86399ab1c0be541909c4c, 5427552fb714de7fb60289e1e237624c68659aaa
i must have been too optimistic about the docker container restarting on fail, checking the monitoring over the last month i see
ssb.mikey.nz (not many followers)
ssb.rootsystems.nz (soooooooo many followers)
i wonder why this is happening?
a quick and dirty fix is to cron schedule a hard restart every day or so, i wonder how we should do that.