oomichi / try-kubernetes

12 stars 5 forks source link

OpenStack services need to boot after amqp booting #2

Closed oomichi closed 5 years ago

oomichi commented 7 years ago

After rebooting OpenStack systems, Neutron services output exceptions on the logs like the following. So OpenStack services need to boot after amqp booting.

2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 128, in _report_state 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent True) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/neutron/agent/rpc.py", line 92, in report_state 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent return method(context, 'report_state', **kwargs) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent retry=self.retry) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent timeout=timeout, retry=retry) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent retry=retry) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 567, in _send 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = self._waiter.wait(msg_id, timeout) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 459, in wait 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent message = self.waiters.get(msg_id, timeout=timeout) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 347, in get 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent 'to message ID %s' % msg_id) 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent MessagingTimeout: Timed out waiting for a reply to message ID c6f05cd6459e400e87719211c5089867 2017-10-11 10:49:56.694 1751 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2017-10-11 10:49:56.715 1751 WARNING oslo.service.loopingcall [-] Function 'neutron.plugins.ml2.drivers.agent._common_agent.CommonAgentLoop._report_state' run outlasted interval by 30.08 sec