search

canonical / charm-microceph

Charm to deploy/manage microceph
Apache License 2.0
2 stars 9 forks source link

Charm restarts `snap.microceph.rgw` service for every config key, triggering systemd `start-limit-hit` event #96

Open fnordahl opened 1 week ago

fnordahl commented 1 week ago

The consequence of this behavior is that the deployment needs manual help to complete in the form of manually issuing:

sudo systemctl stop snap.microceph.rgw.service
sudo systemctl start snap.microceph.rgw.service

on each throttle event until configuration is done.

  1. Is restarting necessary at all?
  2. If it is, could it be aggregated into a final restart after all config keys have been set?

Note that due to the fact that Juju seraializes events on each machine, this behavior also holds up the entire sunbeam deployment.

When identity-service relation completes the charm log looks like this:

2024-07-02 09:59:14 INFO unit.microceph/0.juju-log server.go:325 identity-service:5: Updating RGW Cluster configs
2024-07-02 09:59:14 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [get] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": null}', 'allow_redirects': True}
2024-07-02 09:59:14 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "GET /1.0/configs HTTP/1.1" 200 231
2024-07-02 09:59:14 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":[{"key":"cluster_network","value":"10.5.0.0/16","wait":false},{"key":"osd_pool_default_crush_rule","value":"1","wait":false}]}

2024-07-02 09:59:14 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_url
2024-07-02 09:59:14 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_url", "value": "http://10.5.100.13/openstack-keystone/", "wait": true}'}
2024-07-02 09:59:15 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 09:59:15 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 09:59:15 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_admin_user
2024-07-02 09:59:15 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_admin_user", "value": "svc_remote_34aed337b1b74d948847ce1578b3a0cd-ZPXflt", "wait": true}'}
2024-07-02 09:59:16 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 09:59:16 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 09:59:16 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_admin_password
2024-07-02 09:59:16 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_admin_password", "value": "MOegzKp1qxki", "wait": true}'}
2024-07-02 09:59:17 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 09:59:17 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 09:59:17 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_api_version
2024-07-02 09:59:17 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_api_version", "value": "3", "wait": true}'}
2024-07-02 09:59:18 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 09:59:18 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 09:59:18 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_admin_domain
2024-07-02 09:59:18 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_admin_domain", "value": "service_domain", "wait": true}'}
2024-07-02 09:59:19 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 09:59:19 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 09:59:19 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_admin_project
2024-07-02 09:59:19 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_admin_project", "value": "services", "wait": true}'}

2024-07-02 10:00:20 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:20 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:20 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_accepted_roles
2024-07-02 10:00:20 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_accepted_roles", "value": "Member,member", "wait": true}'}

2024-07-02 10:00:21 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:21 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:21 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_accepted_admin_roles
2024-07-02 10:00:21 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_accepted_admin_roles", "value": "admin", "wait": true}'}
2024-07-02 10:00:22 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:22 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:22 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_token_cache_size
2024-07-02 10:00:22 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_token_cache_size", "value": "500", "wait": true}'}
2024-07-02 10:00:23 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:23 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:23 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_verify_ssl
2024-07-02 10:00:23 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_verify_ssl", "value": "false", "wait": true}'}
2024-07-02 10:00:24 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:24 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:24 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_service_token_enabled
2024-07-02 10:00:24 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_service_token_enabled", "value": "true", "wait": true}'}
2024-07-02 10:00:35 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:35 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:35 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_service_token_accepted_roles
2024-07-02 10:00:35 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_service_token_accepted_roles", "value": "admin", "wait": true}'}
2024-07-02 10:00:36 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:36 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:36 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_s3_auth_use_keystone
2024-07-02 10:00:36 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_s3_auth_use_keystone", "value": "true", "wait": true}'}
2024-07-02 10:00:37 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:37 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:37 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_swift_account_in_url
2024-07-02 10:00:37 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_swift_account_in_url", "value": "true", "wait": true}'}
2024-07-02 10:00:38 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:38 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:38 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Setting microceph cluster config rgw_keystone_implicit_tenants
2024-07-02 10:00:38 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: [put] http+unix://%2Fvar%2Fsnap%2Fmicroceph%2Fcommon%2Fstate%2Fcontrol.socket/1.0/configs, args={'data': '{"key": "rgw_keystone_implicit_tenants", "value": "true", "wait": true}'}
2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: http://localhost:None "PUT /1.0/configs HTTP/1.1" 200 108
2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Response(<Response [200]>) = {"type":"sync","status":"Success","status_code":200,"operation":"","error_code":0,"error":"","metadata":{}}

2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Sending traefik config for rgw interface
2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Updating service endpoints after ingress relation changed
2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Requesting service registration
2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Requested, current channel: reef/edge, reef/edge
2024-07-02 10:00:39 INFO unit.microceph/0.juju-log server.go:325 identity-service:5: Setting active status
2024-07-02 10:00:39 INFO unit.microceph/0.juju-log server.go:325 identity-service:5: Completed guarded section fully: 'Bootstrapping'
2024-07-02 10:00:39 DEBUG unit.microceph/0.juju-log server.go:325 identity-service:5: Command microceph status finished; Output: MicroCeph deployment summary:
- sunbeam-1 (10.5.0.4)
  Services: mds, mgr, mon, rgw, osd
  Disks: 3

Simultaneously the snap.microceph.rgw journal looks like this:

Jul 02 09:59:15 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 09:59:15 sunbeam-1 microceph.rgw[23673]: 2024-07-02T09:59:15.412+0000 7f8d35e9c640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 09:59:15 sunbeam-1 microceph.rgw[23673]: 2024-07-02T09:59:15.412+0000 7f8d396ba0c0 -1 shutting down
Jul 02 09:59:15 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 09:59:15 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 09:59:15 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Consumed 2.457s CPU time.
Jul 02 09:59:15 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 09:59:16 sunbeam-1 radosgw[401339]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 09:59:16 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 09:59:16 sunbeam-1 microceph.rgw[401339]: 2024-07-02T09:59:16.312+0000 7f12325fe640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 09:59:16 sunbeam-1 microceph.rgw[401339]: 2024-07-02T09:59:16.312+0000 7f1235e1c0c0 -1 shutting down
Jul 02 09:59:16 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 09:59:16 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 09:59:16 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 09:59:17 sunbeam-1 radosgw[402224]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 09:59:17 sunbeam-1 microceph.rgw[402224]: 2024-07-02T09:59:17.488+0000 7f82029a9640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 09:59:17 sunbeam-1 microceph.rgw[402224]: 2024-07-02T09:59:17.488+0000 7f82061c70c0 -1 shutting down
Jul 02 09:59:17 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 09:59:17 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 09:59:17 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 09:59:17 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 09:59:18 sunbeam-1 radosgw[403156]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 09:59:18 sunbeam-1 microceph.rgw[403156]: 2024-07-02T09:59:18.436+0000 7f4caadf2640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 09:59:18 sunbeam-1 microceph.rgw[403156]: 2024-07-02T09:59:18.436+0000 7f4cae6100c0 -1 shutting down
Jul 02 09:59:18 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 09:59:18 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 09:59:18 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 09:59:18 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 09:59:19 sunbeam-1 radosgw[404075]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 09:59:19 sunbeam-1 microceph.rgw[404075]: 2024-07-02T09:59:19.496+0000 7fca8608a640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 09:59:19 sunbeam-1 microceph.rgw[404075]: 2024-07-02T09:59:19.496+0000 7fca898a80c0 -1 shutting down
Jul 02 09:59:19 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 09:59:19 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 09:59:19 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 09:59:19 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 09:59:20 sunbeam-1 radosgw[404929]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 09:59:20 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 09:59:20 sunbeam-1 microceph.rgw[404929]: 2024-07-02T09:59:20.420+0000 7ff0c1ea6640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 09:59:20 sunbeam-1 microceph.rgw[404929]: 2024-07-02T09:59:20.420+0000 7ff0c56c40c0 -1 shutting down
Jul 02 09:59:20 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 09:59:20 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 09:59:20 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Start request repeated too quickly.
Jul 02 09:59:20 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Failed with result 'start-limit-hit'.
Jul 02 09:59:20 sunbeam-1 systemd[1]: Failed to start Service for snap application microceph.rgw.
Jul 02 10:00:16 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:16 sunbeam-1 radosgw[420540]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:21 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:21 sunbeam-1 microceph.rgw[420540]: 2024-07-02T10:00:21.451+0000 7f0acdbbf640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:21 sunbeam-1 microceph.rgw[420540]: 2024-07-02T10:00:21.451+0000 7f0ad13dd0c0 -1 shutting down
Jul 02 10:00:21 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:21 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:21 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:21 sunbeam-1 radosgw[422342]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:22 sunbeam-1 microceph.rgw[422342]: 2024-07-02T10:00:22.167+0000 7fcc4f271640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:22 sunbeam-1 microceph.rgw[422342]: 2024-07-02T10:00:22.167+0000 7fcc52a8f0c0 -1 shutting down
Jul 02 10:00:22 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:22 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:22 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:22 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:22 sunbeam-1 radosgw[423309]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:23 sunbeam-1 microceph.rgw[423309]: 2024-07-02T10:00:23.147+0000 7fa7e4068640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:23 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:23 sunbeam-1 microceph.rgw[423309]: 2024-07-02T10:00:23.147+0000 7fa7e78860c0 -1 shutting down
Jul 02 10:00:23 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:23 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:23 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:23 sunbeam-1 radosgw[424181]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:24 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:24 sunbeam-1 microceph.rgw[424181]: 2024-07-02T10:00:24.151+0000 7f60e001f640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:24 sunbeam-1 microceph.rgw[424181]: 2024-07-02T10:00:24.151+0000 7f60e383d0c0 -1 shutting down
Jul 02 10:00:24 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:24 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:24 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:24 sunbeam-1 radosgw[425010]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:25 sunbeam-1 microceph.rgw[425010]: 2024-07-02T10:00:25.051+0000 7f57960be640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:25 sunbeam-1 microceph.rgw[425010]: 2024-07-02T10:00:25.051+0000 7f57998dc0c0 -1 shutting down
Jul 02 10:00:25 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:25 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:25 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:25 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Start request repeated too quickly.
Jul 02 10:00:25 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Failed with result 'start-limit-hit'.
Jul 02 10:00:25 sunbeam-1 systemd[1]: Failed to start Service for snap application microceph.rgw.
Jul 02 10:00:28 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:29 sunbeam-1 radosgw[426724]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:36 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:36 sunbeam-1 microceph.rgw[426724]: 2024-07-02T10:00:36.087+0000 7fe8924c6640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:36 sunbeam-1 microceph.rgw[426724]: 2024-07-02T10:00:36.087+0000 7fe895ce40c0 -1 shutting down
Jul 02 10:00:36 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:36 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:36 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:36 sunbeam-1 radosgw[428911]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:36 sunbeam-1 microceph.rgw[428911]: 2024-07-02T10:00:36.875+0000 7f0631eb6640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:36 sunbeam-1 microceph.rgw[428911]: 2024-07-02T10:00:36.875+0000 7f06356d40c0 -1 shutting down
Jul 02 10:00:36 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:37 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:37 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:37 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:37 sunbeam-1 radosgw[429868]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:37 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:37 sunbeam-1 microceph.rgw[429868]: 2024-07-02T10:00:37.907+0000 7f490778b640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:37 sunbeam-1 microceph.rgw[429868]: 2024-07-02T10:00:37.907+0000 7f490afa90c0 -1 shutting down
Jul 02 10:00:38 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:38 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:38 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:38 sunbeam-1 radosgw[430732]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
Jul 02 10:00:38 sunbeam-1 systemd[1]: Stopping Service for snap application microceph.rgw...
Jul 02 10:00:38 sunbeam-1 microceph.rgw[430732]: 2024-07-02T10:00:38.919+0000 7fb9469f5640 -1 received  signal: Terminated from /sbin/init  (PID: 1) UID: 0
Jul 02 10:00:38 sunbeam-1 microceph.rgw[430732]: 2024-07-02T10:00:38.919+0000 7fb94a2130c0 -1 shutting down
Jul 02 10:00:39 sunbeam-1 systemd[1]: snap.microceph.rgw.service: Deactivated successfully.
Jul 02 10:00:39 sunbeam-1 systemd[1]: Stopped Service for snap application microceph.rgw.
Jul 02 10:00:39 sunbeam-1 systemd[1]: Started Service for snap application microceph.rgw.
Jul 02 10:00:39 sunbeam-1 radosgw[431614]: looking for plugins in '/usr/lib/x86_64-linux-gnu/sasl2', failed to open directory, error: No such file or directory
UtkarshBhatthere commented 1 week ago

@hemanthnakkina the default snap version used is reef/stable right ? Trying to understand why the 2s life check is not working.

UtkarshBhatthere commented 1 week ago

Thanks for reporting this @fnordahl, will look into it.

hemanthnakkina commented 1 week ago

@fnordahl Are you using openstack channel 2024.1/edge?

@UtkarshBhatthere In general, openstack channel 2024.1/edge --> charm-microceph/microceph channel reef/edge openstack channel 2024.1/beta --> charm-microceph/microceph channel reef/beta

Users can always change versions using manfiest file option in sunbeam deployment