search

projectcalico / networking-calico

Calico integration with OpenStack (Neutron)
7 stars 15 forks source link

networking-calico does not work with etcd v3.4 or later, because of URL path change #29

Open vasilinamatov opened 4 years ago

vasilinamatov commented 4 years ago

Hi, I Installed Calico 3.15 on Ubuntu 18 with Openstack Ussuri and with etcd 3.4.0. I have the issue with flapping start/stop neutron-server service.

Aug 11 07:10:25 slpr-omb101 systemd[1]: Stopped OpenStack Neutron Server.
Aug 11 07:10:25 slpr-omb101 systemd[1]: Started OpenStack Neutron Server.
Aug 11 07:10:37 slpr-omb101 neutron-server[21533]: /usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py:22: PkgResourcesDeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Aug 11 07:10:37 slpr-omb101 neutron-server[21533]:   return pkg_resources.EntryPoint.parse(“x=” + s).load(False)
Aug 11 07:10:37 slpr-omb101 systemd[1]: neutron-server.service: Main process exited, code=exited, status=1/FAILURE
Aug 11 07:10:42 slpr-omb101 systemd[1]: neutron-server.service: Failed with result ‘exit-code’.
Aug 11 07:10:43 slpr-omb101 systemd[1]: neutron-server.service: Service hold-off time over, scheduling restart.
Aug 11 07:10:43 slpr-omb101 systemd[1]: neutron-server.service: Scheduled restart job, restart counter is at 13.
Aug 11 07:10:43 slpr-omb101 systemd[1]: Stopped OpenStack Neutron Server.
Aug 11 07:10:43 slpr-omb101 systemd[1]: Started OpenStack Neutron Server.

Here is the neutron logs:

2020-08-11 09:16:01.762 43936 INFO neutron.service [-] Neutron service started, listening on 0.0.0.0:9696
2020-08-11 09:16:01.762 44014 INFO neutron.wsgi [-] (44014) wsgi starting up on http://0.0.0.0:9696
2020-08-11 09:16:01.763 43936 INFO oslo_service.service [-] Starting 24 workers
2020-08-11 09:16:01.763 44015 INFO neutron.wsgi [-] (44015) wsgi starting up on http://0.0.0.0:9696
2020-08-11 09:16:01.799 43936 INFO oslo_service.service [-] Starting 1 workers
2020-08-11 09:16:01.803 43936 INFO oslo_service.service [-] Starting 1 workers
2020-08-11 09:16:11.606 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Doing Calico mechanism driver initialisation in process 43936
2020-08-11 09:16:11.607 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] db = <networking_calico.plugins.calico.plugin.CalicoPlugin object at 0x7fb0abea8da0>
2020-08-11 09:16:11.609 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [req-7acd41c1-b36c-4d52-bc21-38d1b46f0fa4 - - - - -] Calico mechanism driver initialisation done in process 43936
2020-08-11 09:16:11.609 43936 INFO networking_calico.etcdv3 [-] TLS disabled, using HTTP to connect to etcd.
2020-08-11 09:16:11.613 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Periodic resync thread started
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Status updating thread started.
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election [-] Election greenlet exiting: AttributeError(“‘Etcd3Exception’ object has no attribute ‘detail_text’“,): AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 142, in _vote
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     value, mod_revision = etcdv3.get(self._key)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 88, in get
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     results = client.get(key, metadata=True)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 216, in get
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     json=payload)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     return super(Etcd3AuthClient, self).post(*args, **kwargs)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     raise exceptions.Etcd3Exception(resp.reason)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 110, in _run
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._vote()
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 150, in _vote
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._log_exception(“read current master”, e)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 324, in _log_exception
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._key, exc, exc.detail_text)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election [-] Failed to step down as master.  Ignoring.: etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 142, in _vote
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     value, mod_revision = etcdv3.get(self._key)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 88, in get
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     results = client.get(key, metadata=True)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 216, in get
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     json=payload)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     return super(Etcd3AuthClient, self).post(*args, **kwargs)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     raise exceptions.Etcd3Exception(resp.reason)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 110, in _run
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._vote()
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 150, in _vote
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._log_exception(“read current master”, e)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 324, in _log_exception
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._key, exc, exc.detail_text)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 133, in _run
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     sys.exit(1)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election SystemExit: 1
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 337, in _attempt_step_down
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     etcdv3.delete(self._key, existing_value=self.id_string)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 221, in delete
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     result = client.transaction(txn)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 332, in transaction
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     data=json.dumps(txn))
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     return super(Etcd3AuthClient, self).post(*args, **kwargs)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     raise exceptions.Etcd3Exception(resp.reason)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.852 43955 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43953 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43978 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43952 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44012 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43970 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43981 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43962 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44015 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43984 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43972 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43979 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43982 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44006 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44010 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43976 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43985 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44001 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44013 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.853 43966 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
root@slpr-omb101:~# systemctl status neutron-server
● neutron-server.service - OpenStack Neutron Server
   Loaded: loaded (/lib/systemd/system/neutron-server.service; enabled; vendor preset: enabled)
   Active: deactivating (stop-sigterm) (Result: exit-code) since Tue 2020-08-11 09:23:59 EDT; 2s ago
  Process: 49135 ExecStart=/etc/init.d/neutron-server systemd-start (code=exited, status=1/FAILURE)
 Main PID: 49135 (code=exited, status=1/FAILURE)
    Tasks: 25 (limit: 7372)
   CGroup: /system.slice/neutron-server.service
           ├─361 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─362 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─363 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─364 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─365 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─366 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─367 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─368 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─369 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─370 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─371 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─373 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─374 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─377 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─378 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─379 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─380 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─381 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─382 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─383 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─384 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─385 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─387 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─388 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           └─389 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
Aug 11 09:23:47 slpr-omb101 systemd[1]: Started OpenStack Neutron Server.
Aug 11 09:23:59 slpr-omb101 neutron-server[49135]: /usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py:22: PkgResourcesDeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Aug 11 09:23:59 slpr-omb101 neutron-server[49135]:   return pkg_resources.EntryPoint.parse(“x=” + s).load(False)
Aug 11 09:23:59 slpr-omb101 systemd[1]: neutron-server.service: Main process exited, code=exited, status=1/FAILURE
vasili.namatov  3 hours ago
root@slpr-omb101:~# systemctl status calico-dhcp-agent.service
● calico-dhcp-agent.service - Calico DHCP agent
   Loaded: loaded (/lib/systemd/system/calico-dhcp-agent.service; enabled; vendor preset: enabled)
   Active: active (running) since Tue 2020-08-11 09:24:48 EDT; 1s ago
 Main PID: 808 (/usr/bin/python)
    Tasks: 1 (limit: 7372)
   CGroup: /system.slice/calico-dhcp-agent.service
           └─808 /usr/bin/python3 /usr/bin/calico-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 348, in get_status
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     status = client.status()
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 97, in status
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     json={})
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     return super(Etcd3AuthClient, self).post(*args, **kwargs)
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     raise exceptions.Etcd3Exception(resp.reason)
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron etcd3gw.exceptions.Etcd3Exception: Not Found
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron
root@slpr-omb101:~# systemctl status calico-dhcp-agent.service
● calico-dhcp-agent.service - Calico DHCP agent
   Loaded: loaded (/lib/systemd/system/calico-dhcp-agent.service; enabled; vendor preset: enabled)
   Active: activating (auto-restart) (Result: exit-code) since Tue 2020-08-11 09:24:53 EDT; 17ms ago
  Process: 822 ExecStart=/usr/bin/calico-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini (code=exited, status=1/FAILURE)
 Main PID: 822 (code=exited, status=1/FAILURE)
Aug 11 09:24:53 slpr-omb101 systemd[1]: calico-dhcp-agent.service: Failed with result ‘exit-code’.
vasili.namatov  3 hours ago
root@slpr-omb101:~# systemctl status calico-felix
● calico-felix.service - Calico Felix agent
   Loaded: loaded (/lib/systemd/system/calico-felix.service; enabled; vendor preset: enabled)
   Active: active (running) since Tue 2020-08-11 09:25:37 EDT; 4s ago
  Process: 1118 ExecStartPre=/bin/mkdir -p /var/run/calico (code=exited, status=0/SUCCESS)
 Main PID: 1119 (calico-felix)
    Tasks: 21 (limit: 7372)
   CGroup: /system.slice/calico-felix.service
           └─1119 /usr/bin/calico-felix
Aug 11 09:25:37 slpr-omb101 systemd[1]: Starting Calico Felix agent...
Aug 11 09:25:37 slpr-omb101 systemd[1]: Started Calico Felix agent.

Maybe I’m missing some important configuration which must be in Ussuri.. Cause last time I worked with Rocky and calico 3.12 which was not supported python3 but it worked very well.

root@slpr-omb102:~# apt install python-etcd3gw
Reading package lists... Done
Building dependency tree
Reading state information... Done
python-etcd3gw is already the newest version (0.2.1-1).
0 upgraded, 0 newly installed, 0 to remove and 243 not upgraded.
root@slpr-omb102:~# apt install python3-etcd3gw
Reading package lists... Done
Building dependency tree
Reading state information... Done
python3-etcd3gw is already the newest version (0.2.1-1).
0 upgraded, 0 newly installed, 0 to remove and 243 not upgraded.

You mean I can continue to use 3.3.11 as I used before with calico 3.12? I mean now I can use the same 3.3.11 with calico 3.15? Do you think the issue with etcd proper?

nelljerram commented 4 years ago

@vasilinamatov I believe there are 2 problems here.

Firstly, etcd 3.4 is problematic because they changed URL paths from "v3alpha" to "v3beta". We should update to handle this, but in the meantime I recommend sticking with etcd 3.3.

Secondly, you're using the wrong version of etcd3gw. Please see https://docs.projectcalico.org/getting-started/openstack/installation/ubuntu for how to install the correct version.

Can you let us know if you still see any problem after fixing those two things?