canonical / prometheus-openstack-exporter

OpenStack exporter for the prometheus monitoring system
GNU General Public License v3.0
128 stars 113 forks source link

Socket errors causing frequent exporter restarts #41

Closed brokoli18 closed 1 year ago

brokoli18 commented 6 years ago

We have noticed the below trackback in the syslog of the openstack exporter, which appears quite frequently:

Traceback (most recent call last): File "/snap/prometheus-openstack-exporter/24/usr/lib/python2.7/SocketServer.py", line 571, in process_request self.finish_request(request, client_address) File "/snap/prometheus-openstack-exporter/24/usr/lib/python2.7/SocketServer.py", line 331, in finish_request self.RequestHandlerClass(request, client_address, self) File "/snap/prometheus-openstack-exporter/24/bin/prometheus-openstack-exporter", line 632, in handler OpenstackExporterHandler(*args, *kwargs) File "/snap/prometheus-openstack-exporter/24/bin/prometheus-openstack-exporter", line 593, in init BaseHTTPRequestHandler.init(self, args, **kwargs) File "/snap/prometheus-openstack-exporter/24/usr/lib/python2.7/SocketServer.py", line 654, in init self.finish() File "/snap/prometheus-openstack-exporter/24/usr/lib/python2.7/SocketServer.py", line 713, in finish self.wfile.close() File "/snap/prometheus-openstack-exporter/24/usr/lib/python2.7/socket.py", line 283, in close self.flush() File "/snap/prometheus-openstack-exporter/24/usr/lib/python2.7/socket.py", line 307, in flush self._sock.sendall(view[write_offset:write_offset+buffer_size]) error: [Errno 32] Broken pipe

It seems that the exporter is trying to talk to a machine that is offline, and does not handle the error gracefully which causes it to crash.

Pjack commented 1 year ago

Close the issue that stale over years.