search

canonical / prometheus-juju-exporter

GNU General Public License v3.0
2 stars 8 forks source link

exporter fails to connect to model with `Cannot assign requested address` #43

Closed mkalcok closed 1 year ago

mkalcok commented 1 year ago

Following error was observed in Prometheus Juju Exporter. This issue always affected only subset of deployed p-j-e instances. e.g. If there are 3 p-j-e deployed in a cloud, only 1 or 2 were affected by this issue.

Logs:

Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:03:56,386 INFO - Collecting gauges...
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: INFO:prometheus_juju_exporter.exporter:Collecting gauges...
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:03:56,445 ERROR - Failed connecting to model 'c877b743-8c20-4255-872d-3f9d21359a20': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model 'c877b743-8c20-4255-872d-3f9d21359a20': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:03:56,459 ERROR - Failed connecting to model '6382a195-4f80-47d0-8d70-519f99e5ea5f': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model '6382a195-4f80-47d0-8d70-519f99e5ea5f': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:03:56,476 ERROR - Failed connecting to model 'f2d3187b-2bbe-4147-8e06-ff447b13202c': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model 'f2d3187b-2bbe-4147-8e06-ff447b13202c': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:03:56,490 ERROR - Failed connecting to model '20ea56b6-6bc4-453f-8821-6233662fda45': [Errno 99] Cannot assign requested address
Apr 02 07:03:56 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model '20ea56b6-6bc4-453f-8821-6233662fda45': [Errno 99] Cannot assign requested address
Apr 02 07:03:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:03:57,493 INFO - Gauges collected and ready for exporting.
Apr 02 07:03:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: INFO:prometheus_juju_exporter.exporter:Gauges collected and ready for exporting.
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:18:57,558 INFO - Collecting gauges...
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: INFO:prometheus_juju_exporter.exporter:Collecting gauges...
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:18:57,610 ERROR - Failed connecting to model 'c877b743-8c20-4255-872d-3f9d21359a20': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model 'c877b743-8c20-4255-872d-3f9d21359a20': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:18:57,621 ERROR - Failed connecting to model '6382a195-4f80-47d0-8d70-519f99e5ea5f': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model '6382a195-4f80-47d0-8d70-519f99e5ea5f': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:18:57,631 ERROR - Failed connecting to model 'f2d3187b-2bbe-4147-8e06-ff447b13202c': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model 'f2d3187b-2bbe-4147-8e06-ff447b13202c': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:18:57,642 ERROR - Failed connecting to model '20ea56b6-6bc4-453f-8821-6233662fda45': [Errno 99] Cannot assign requested address
Apr 02 07:18:57 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.collector:Failed connecting to model '20ea56b6-6bc4-453f-8821-6233662fda45': [Errno 99] Cannot assign requested address
Apr 02 07:18:58 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:18:58,645 INFO - Gauges collected and ready for exporting.
Apr 02 07:18:58 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: INFO:prometheus_juju_exporter.exporter:Gauges collected and ready for exporting.
Apr 02 07:33:58 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:33:58,682 INFO - Collecting gauges...
Apr 02 07:33:58 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: INFO:prometheus_juju_exporter.exporter:Collecting gauges...
Apr 02 07:33:58 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: 2023-04-02 07:33:58,693 ERROR - Collection job resulted in error: [Errno 99] Cannot assign requested address
Apr 02 07:33:58 juju-1 prometheus-juju-exporter.prometheus-juju-exporter[1275040]: ERROR:prometheus_juju_exporter.exporter:Collection job resulted in error: [Errno 99] Cannot assign requested address
Apr 02 07:33:59 juju-1 systemd[1]: snap.prometheus-juju-exporter.prometheus-juju-exporter.service: Main process exited, code=exited, status=1/FAILURE
Apr 02 07:33:59 juju-1 systemd[1]: snap.prometheus-juju-exporter.prometheus-juju-exporter.service: Failed with result 'exit-code'.
chanchiwai-ray commented 1 year ago

After investigate with the issue reporter, this is likely to be an environment issue, not specifically to p-j-e, I will close it for now. If you have more evident that this is caused by p-j-e, please feel free to re-open it. Thanks!