search

compose / governor

Runners to orchestrate a high-availability PostgreSQL
MIT License
511 stars 75 forks source link

etcd returns 500 internal server error on ubuntu which causes postgres to crash. #16

Open shashankmjain opened 9 years ago

shashankmjain commented 9 years ago

Hi, Postgres server crashes as a node tries to write a value in etcd and gets 500.

self.put_client_path("/members/%s" % member, {"value": connection_string, "ttl": self.ttl})

File "/home/i074560/shashank/governor/helpers/etcd.py", line 40, in put_client_path opener.open(request) File "/usr/lib/python2.7/urllib2.py", line 406, in open response = meth(req, response) File "/usr/lib/python2.7/urllib2.py", line 519, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python2.7/urllib2.py", line 444, in error return self._call_chain(_args) File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain result = func(_args) File "/usr/lib/python2.7/urllib2.py", line 527, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 500: Internal Server Error LOG: received fast shutdown request

shashankmjain commented 9 years ago

What is the impact if we just catch this exception and retry for few times instead of just letting postgres crash on first attempt?