ahdinosaur / ssb-pub

easily host your own Secure ScuttleButt (SSB) pub in a docker container
http://butt.nz/
GNU Affero General Public License v3.0
158 stars 25 forks source link

crashes without restart? #1

Closed ahdinosaur closed 6 years ago

ahdinosaur commented 6 years ago

i must have been too optimistic about the docker container restarting on fail, checking the monitoring over the last month i see

ssb.mikey.nz (not many followers)

screenshot_20171218_221142

ssb.rootsystems.nz (soooooooo many followers)

screenshot_20171218_221223

i wonder why this is happening?

a quick and dirty fix is to cron schedule a hard restart every day or so, i wonder how we should do that.

ahdinosaur commented 6 years ago

i guess i have no idea what the actual uptime on these servers are, i'm only making shit up. should probably setup a monitor that checks for actual ssb availability. 😄

ahdinosaur commented 6 years ago

this keeps happening, especially on the pub with the most load. going to try using dumb-init to see if that will fix the problem, where the hypothesis is that the node process is becoming defunkt and docker doesn't realize it needs to restart.

ahdinosaur commented 6 years ago

this is fixed with e2d2c7775a456661764f8325dcb2badbd98f9d28, b0034a37f00e90ab9dc86399ab1c0be541909c4c, 5427552fb714de7fb60289e1e237624c68659aaa