201505 Unexpected intermittent outage due to networking

webplatform / ops

http://webplatform.github.io/ops/

5 stars 1 forks source link

Closed renoirb closed 9 years ago

renoirb commented 9 years ago

From time to time the site experience issues.

Un predictable outages, sometimes coinciding with hard drive maintenance at DreamHost
Its been observed that some outages are caused by internal network latency ("net split")
The master database server was the most frequently affected

renoirb commented 9 years ago

On friday 22, I shut down db1-masterdb and promoted db2 as master. It should hold until I recreate new instances.

renoirb commented 9 years ago

Everything is running smoothly as is. Closing work item.