pulibrary / princeton_ansible

Ansible Roles and Playbooks for Princeton University Library
10 stars 4 forks source link

NGINX on Load Balancer should restart when it crashes #5382

Open tpendragon opened 5 days ago

tpendragon commented 5 days ago

We recently had an incident where nginx segfaulted after a reload and never came back up. It should come back up when it crashes.

Related incident: https://docs.google.com/document/d/1mSh4babVNaUfKs6V9NszJ2jYLdwKXJM68UbMdKv4Wv0/edit

Acceptance Criteria

acozine commented 3 days ago

Related to #4893.

acozine commented 3 days ago

Looks like our HA solution, keepalived, expects initd/service instead of systemd so we need to be careful about how we mix the configs. It's probably time to open a ticket with nginx for a bulletproof, integrated solution.