search

a10networks / acos-client

ACOS API Client
Apache License 2.0
35 stars 61 forks source link

[STACK-2220] acos-client timeout too short #340

Closed ytsai-a10 closed 3 years ago

ytsai-a10 commented 3 years ago

Description

acos-client side PR: https://github.com/a10networks/acos-client/pull/340 a10-octavia side PR: https://github.com/a10networks/a10-octavia/pull/363

If Bug Fix:

According to the audi log:

vThunder(NOLICENSE)#show audi
Apr 13 2021 10:46:53  [admin] axapi: [7:192.168.0.127:34384] RESP HTTP status 400  Bad Request : Failed to acquire a DHCP offer from DHCP server.
Apr 13 2021 10:46:53  [admin] axapi: [7:192.168.0.127:34384] payload section 1
{"ethernet": {"action": "enable", "ip": {"dhcp": 1}, "ifnum": "1", "name": "DataPort"}}
Apr 13 2021 10:45:50  [admin] axapi: [7:192.168.0.127:34384] POST: /axapi/v3/interface/ethernet/1

Jira Ticket

https://a10networks.atlassian.net/browse/STACK-2220

Technical Approach

  1. set acos-client default timeout to 300, which is in another PR
  2. public_subnet should enable dhcp
  3. Fix some mirror issue in our revert flow

Config Changes

N/A

Test Cases

Manual Testing

After the patch, we can see the axapi response with the error message now (which is DHCP failed)

Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: WARNING a10_octavia.controller.worker.controller_worker [-] Flow 'octavia-create-loadbalancer-flow' (ff8cff27-6f22-4637-85ce-360e57621c8f) transitioned into state 'REVERTED' from state 'RUNNING'
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server [-] Exception during message handling: DhcpAcquireFailed: 654311505 Failed to acquire a DHCP offer from DHCP server.
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/opt/stack/source/a10-octavia/vThunder/a10_octavia/controller/queue/endpoint.py", line 45, in create_load_balancer
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     self.worker.create_load_balancer(load_balancer_id, flavor)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/tenacity/__init__.py", line 292, in wrapped_f
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     return self.call(f, *args, **kw)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/tenacity/__init__.py", line 358, in call
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/tenacity/__init__.py", line 319, in iter
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     return fut.result()
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/concurrent/futures/_base.py", line 455, in result
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/tenacity/__init__.py", line 361, in call
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/opt/stack/source/a10-octavia/vThunder/a10_octavia/controller/worker/controller_worker.py", line 312, in create_load_balancer
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     create_lb_tf.run()
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/taskflow/types/failure.py", line 339, in reraise_if_any
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/taskflow/types/failure.py", line 346, in reraise
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     six.reraise(*self._exc_info)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/opt/stack/source/a10-octavia/vThunder/a10_octavia/controller/worker/tasks/decorators.py", line 52, in wrapper
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     result = func(self, *args, **kwargs)
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server   File "/opt/stack/source/a10-octavia/vThunder/a10_octavia/controller/worker/tasks/vthunder_tasks.py", line 182, in execute
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server     raise e
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server DhcpAcquireFailed: 654311505 Failed to acquire a DHCP offer from DHCP server.
Apr 13 14:59:06 openstack-4 a10-octavia-worker[25972]: ERROR oslo_messaging.rpc.server