search

canonical / mysql-router-k8s-operator

Mysql router operator charm for kubernetes
https://charmhub.io/mysql-router-k8s
Apache License 2.0
2 stars 7 forks source link

database_provides databag not updated when database_requires databag broken & re-created #80

Closed carlcsaposs-canonical closed 1 year ago

carlcsaposs-canonical commented 1 year ago

Steps to reproduce

  1. juju deploy mysql-router-k8s --channel 8.0/edge
  2. juju deploy mysql-k8s --channel 8.0/edge --trust
  3. juju deploy mysql-test-app
  4. juju relate mysql-router-k8s mysql-k8s
  5. juju relate mysql-router-k8s mysql-test-app
  6. Wait for active/idle
  7. jhack show-relation mysql-router-k8s:database mysql-test-app:database -> username is relation-3-4
  8. juju remove-relation mysql-k8s mysql-router-k8s
  9. juju deploy mysql-k8s --channel 8.0/edge --trust mysql-2nd-k8s
  10. juju relate mysql-router-k8s mysql-2nd-k8s
  11. jhack show-relation mysql-router-k8s:database mysql-test-app:database -> username is still relation-3-4
  12. jhack show-relation mysql-2nd-k8s:database mysql-router-k8s:backend-database -> username is relation-6

Expected behavior

Username in step 11 should be relation-6-4 and new user should be created

Actual behavior

New user not created, username is relation-3-4

Versions

Operating system: Ubuntu 22.04.2 LTS

Juju CLI: 2.9.43-ubuntu-amd64

Juju agent: 2.9.43 (installed following these instructions: https://chat.canonical.com/canonical/pl/g6swyah9zty15kx1w81e31u3jy)

mysql-k8s charm revision: 82 mysql-router-k8s charm revision: 36

microk8s: MicroK8s v1.26.4 revision 5219

Additional context

github-actions[bot] commented 1 year ago

https://warthogs.atlassian.net/browse/DPE-2002

carlcsaposs-canonical commented 1 year ago
juju debug-log --replay ```shell controller-0: 18:54:01 INFO juju.worker.apicaller [066155] "controller-0" successfully connected to "localhost:17070" controller-0: 18:54:01 INFO juju.worker.logforwarder config change - log forwarding not enabled controller-0: 18:54:01 INFO juju.worker.logger logger worker started controller-0: 18:54:01 INFO juju.worker.pruner.statushistory status history config: max age: 336h0m0s, max collection size 5120M for foo4 (066155ed-0b84-4ae3-83dc-081bafb4d309) controller-0: 18:54:01 INFO juju.worker.pruner.action status history config: max age: 336h0m0s, max collection size 5120M for foo4 (066155ed-0b84-4ae3-83dc-081bafb4d309) model-066155ed-0b84-4ae3-83dc-081bafb4d309: 18:54:05 INFO juju.worker.caasupgrader abort check blocked until version event received model-066155ed-0b84-4ae3-83dc-081bafb4d309: 18:54:05 INFO juju.worker.caasupgrader unblocking abort check model-066155ed-0b84-4ae3-83dc-081bafb4d309: 18:54:06 INFO juju.worker.muxhttpserver starting http server on [::]:17071 model-066155ed-0b84-4ae3-83dc-081bafb4d309: 18:54:06 INFO juju.worker.caasadmission ensuring model k8s webhook configurations controller-0: 18:54:20 INFO juju.worker.caasapplicationprovisioner.runner start "mysql-router-k8s" controller-0: 18:54:20 INFO juju.worker.caasapplicationprovisioner.mysql-router-k8s scaling application "mysql-router-k8s" to desired scale 1 controller-0: 18:54:20 INFO juju.worker.caasapplicationprovisioner.mysql-router-k8s scaling application "mysql-router-k8s" to desired scale 1 controller-0: 18:54:24 INFO juju.worker.caasapplicationprovisioner.mysql-router-k8s scaling application "mysql-router-k8s" to desired scale 1 unit-mysql-router-k8s-0: 18:54:25 INFO juju.cmd running containerAgent [2.9.43 8ae2c6e22e285d4fe326902202e955dd3fff4384 gc go1.20.3] unit-mysql-router-k8s-0: 18:54:25 INFO juju.cmd.containeragent.unit start "unit" unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.upgradesteps upgrade steps for 2.9.43 have already been run. unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.probehttpserver starting http server on [::]:65301 unit-mysql-router-k8s-0: 18:54:25 INFO juju.api cannot resolve "controller-service.controller-microscale.svc.cluster.local": lookup controller-service.controller-microscale.svc.cluster.local: operation was canceled unit-mysql-router-k8s-0: 18:54:25 INFO juju.api connection established to "wss://10.152.183.78:17070/model/066155ed-0b84-4ae3-83dc-081bafb4d309/api" unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.apicaller [066155] "unit-mysql-router-k8s-0" successfully connected to "10.152.183.78:17070" unit-mysql-router-k8s-0: 18:54:25 INFO juju.api connection established to "wss://controller-service.controller-microscale.svc.cluster.local:17070/model/066155ed-0b84-4ae3-83dc-081bafb4d309/api" unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.apicaller [066155] "unit-mysql-router-k8s-0" successfully connected to "controller-service.controller-microscale.svc.cluster.local:17070" unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.migrationminion migration phase is now: NONE unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.logger logger worker started unit-mysql-router-k8s-0: 18:54:25 WARNING juju.worker.proxyupdater unable to set snap core settings [proxy.http= proxy.https= proxy.store=]: exec: "snap": executable file not found in $PATH, output: "" unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.leadership mysql-router-k8s/0 promoted to leadership of mysql-router-k8s unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.caasupgrader abort check blocked until version event received unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.caasupgrader unblocking abort check unit-mysql-router-k8s-0: 18:54:25 INFO juju.agent.tools ensure jujuc symlinks in /var/lib/juju/tools/unit-mysql-router-k8s-0 unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.uniter unit "mysql-router-k8s/0" started unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.uniter resuming charm install unit-mysql-router-k8s-0: 18:54:25 INFO juju.worker.uniter.charm downloading ch:amd64/jammy/mysql-router-k8s-36 from API server unit-mysql-router-k8s-0: 18:54:25 INFO juju.downloader downloading from ch:amd64/jammy/mysql-router-k8s-36 unit-mysql-router-k8s-0: 18:54:25 INFO juju.downloader download complete ("ch:amd64/jammy/mysql-router-k8s-36") unit-mysql-router-k8s-0: 18:54:25 INFO juju.downloader download verified ("ch:amd64/jammy/mysql-router-k8s-36") controller-0: 18:54:28 INFO juju.worker.caasapplicationprovisioner.mysql-router-k8s scaling application "mysql-router-k8s" to desired scale 1 unit-mysql-router-k8s-0: 18:54:31 INFO juju.worker.uniter hooks are retried true unit-mysql-router-k8s-0: 18:54:32 INFO juju.worker.uniter found queued "install" hook unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:33 INFO unit.mysql-router-k8s/0.juju-log Running legacy hooks/install. unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Charm called itself via hooks/install. unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Legacy hooks/install exited with status 0. unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Using local storage: not a Kubernetes podspec charm unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Initializing SQLite local storage: /var/lib/juju/agents/unit-mysql-router-k8s-0/charm/.unit-state.db. unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Emitting Juju event install. unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Patching k8s service name='mysql-router-k8s', ro_port=6447, rw_port=6446 unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None socket_options=None unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log connect_tcp.complete return_value= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log start_tls.complete return_value= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_headers.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_headers.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_body.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_body.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_headers.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'435398c2-029c-47b0-8f91-d73aaab29ef2'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:54:33 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-router-k8s-0: 18:54:33 INFO unit.mysql-router-k8s/0.juju-log HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-router-k8s-0 "HTTP/1.1 200 OK" unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_body.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_body.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log response_closed.started unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log response_closed.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_headers.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_headers.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_body.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log send_request_body.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_headers.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'28553fdf-b290-4e28-8754-909a46ef2a38'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:54:33 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-router-k8s-0: 18:54:33 INFO unit.mysql-router-k8s/0.juju-log HTTP Request: PATCH https://10.152.183.1/api/v1/namespaces/foo4/services/mysql-router-k8s?fieldManager=mysql-router-k8s "HTTP/1.1 200 OK" unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_body.started request= unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log receive_response_body.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log response_closed.started unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log response_closed.complete unit-mysql-router-k8s-0: 18:54:33 DEBUG unit.mysql-router-k8s/0.juju-log Patched k8s service name='mysql-router-k8s', ro_port=6447, rw_port=6446 controller-0: 18:54:34 INFO juju.worker.caasapplicationprovisioner.runner start "mysql-k8s" controller-0: 18:54:34 INFO juju.worker.caasapplicationprovisioner.mysql-k8s scaling application "mysql-k8s" to desired scale 1 unit-mysql-router-k8s-0: 18:54:34 INFO juju.worker.uniter.operation ran "install" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:54:34 DEBUG unit.mysql-router-k8s/0.juju-log mysql-router-peers:0: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:34 DEBUG unit.mysql-router-k8s/0.juju-log mysql-router-peers:0: Emitting Juju event mysql_router_peers_relation_created. unit-mysql-router-k8s-0: 18:54:35 INFO juju.worker.uniter.operation ran "mysql-router-peers-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:54:35 INFO juju.worker.uniter found queued "leader-elected" hook unit-mysql-router-k8s-0: 18:54:35 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:35 DEBUG unit.mysql-router-k8s/0.juju-log Emitting Juju event leader_elected. unit-mysql-router-k8s-0: 18:54:35 DEBUG unit.mysql-router-k8s/0.juju-log Set app status to BlockedStatus('Missing relation: backend-database') unit-mysql-router-k8s-0: 18:54:35 DEBUG unit.mysql-router-k8s/0.juju-log Set unit status to ActiveStatus('') unit-mysql-router-k8s-0: 18:54:35 INFO juju.worker.uniter.operation ran "leader-elected" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:54:36 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:36 DEBUG unit.mysql-router-k8s/0.juju-log Emitting Juju event mysql_router_pebble_ready. unit-mysql-router-k8s-0: 18:54:36 DEBUG unit.mysql-router-k8s/0.juju-log State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=False, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=None, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:54:36 DEBUG unit.mysql-router-k8s/0.juju-log Set app status to BlockedStatus('Missing relation: backend-database') unit-mysql-router-k8s-0: 18:54:36 DEBUG unit.mysql-router-k8s/0.juju-log Set unit status to ActiveStatus('') unit-mysql-router-k8s-0: 18:54:36 INFO juju.worker.uniter.operation ran "mysql-router-pebble-ready" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:54:37 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:37 DEBUG unit.mysql-router-k8s/0.juju-log Emitting Juju event config_changed. unit-mysql-router-k8s-0: 18:54:37 INFO juju.worker.uniter.operation ran "config-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:54:37 INFO juju.worker.uniter found queued "start" hook unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:38 INFO unit.mysql-router-k8s/0.juju-log Running legacy hooks/start. unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Charm called itself via hooks/start. unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Legacy hooks/start exited with status 0. unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Emitting Juju event start. unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Set app status to BlockedStatus('Missing relation: backend-database') unit-mysql-router-k8s-0: 18:54:38 DEBUG unit.mysql-router-k8s/0.juju-log Set unit status to ActiveStatus('') unit-mysql-router-k8s-0: 18:54:38 INFO juju.worker.uniter.operation ran "start" hook (via hook dispatching script: dispatch) controller-0: 18:54:39 INFO juju.worker.caasapplicationprovisioner.mysql-k8s scaling application "mysql-k8s" to desired scale 1 unit-mysql-k8s-0: 18:54:46 INFO juju.cmd running containerAgent [2.9.43 8ae2c6e22e285d4fe326902202e955dd3fff4384 gc go1.20.3] unit-mysql-k8s-0: 18:54:46 INFO juju.cmd.containeragent.unit start "unit" unit-mysql-k8s-0: 18:54:46 INFO juju.worker.upgradesteps upgrade steps for 2.9.43 have already been run. unit-mysql-k8s-0: 18:54:46 INFO juju.worker.probehttpserver starting http server on [::]:65301 unit-mysql-k8s-0: 18:54:46 INFO juju.api connection established to "wss://controller-service.controller-microscale.svc.cluster.local:17070/model/066155ed-0b84-4ae3-83dc-081bafb4d309/api" unit-mysql-k8s-0: 18:54:46 INFO juju.worker.apicaller [066155] "unit-mysql-k8s-0" successfully connected to "controller-service.controller-microscale.svc.cluster.local:17070" unit-mysql-k8s-0: 18:54:46 INFO juju.worker.migrationminion migration phase is now: NONE unit-mysql-k8s-0: 18:54:46 INFO juju.worker.logger logger worker started unit-mysql-k8s-0: 18:54:46 WARNING juju.worker.proxyupdater unable to set snap core settings [proxy.http= proxy.https= proxy.store=]: exec: "snap": executable file not found in $PATH, output: "" unit-mysql-k8s-0: 18:54:46 INFO juju.worker.leadership mysql-k8s/0 promoted to leadership of mysql-k8s unit-mysql-k8s-0: 18:54:46 INFO juju.worker.caasupgrader abort check blocked until version event received unit-mysql-k8s-0: 18:54:46 INFO juju.worker.caasupgrader unblocking abort check unit-mysql-k8s-0: 18:54:46 INFO juju.agent.tools ensure jujuc symlinks in /var/lib/juju/tools/unit-mysql-k8s-0 unit-mysql-k8s-0: 18:54:46 INFO juju.worker.uniter unit "mysql-k8s/0" started unit-mysql-k8s-0: 18:54:46 INFO juju.worker.uniter resuming charm install unit-mysql-k8s-0: 18:54:46 INFO juju.worker.uniter.charm downloading ch:amd64/jammy/mysql-k8s-82 from API server unit-mysql-k8s-0: 18:54:46 INFO juju.downloader downloading from ch:amd64/jammy/mysql-k8s-82 unit-mysql-k8s-0: 18:54:46 INFO juju.downloader download complete ("ch:amd64/jammy/mysql-k8s-82") unit-mysql-k8s-0: 18:54:46 INFO juju.downloader download verified ("ch:amd64/jammy/mysql-k8s-82") controller-0: 18:54:51 INFO juju.worker.caasapplicationprovisioner.runner start "mysql-test-app" controller-0: 18:54:56 INFO juju.worker.caasapplicationprovisioner.mysql-test-app scaling application "mysql-test-app" to desired scale 1 unit-mysql-test-app-0: 18:54:56 INFO juju.cmd running containerAgent [2.9.43 8ae2c6e22e285d4fe326902202e955dd3fff4384 gc go1.20.3] unit-mysql-test-app-0: 18:54:56 INFO juju.cmd.containeragent.unit start "unit" unit-mysql-test-app-0: 18:54:56 INFO juju.worker.upgradesteps upgrade steps for 2.9.43 have already been run. unit-mysql-test-app-0: 18:54:56 INFO juju.worker.probehttpserver starting http server on [::]:65301 unit-mysql-test-app-0: 18:54:56 INFO juju.api cannot resolve "controller-service.controller-microscale.svc.cluster.local": lookup controller-service.controller-microscale.svc.cluster.local: operation was canceled unit-mysql-test-app-0: 18:54:56 INFO juju.api connection established to "wss://10.152.183.78:17070/model/066155ed-0b84-4ae3-83dc-081bafb4d309/api" unit-mysql-test-app-0: 18:54:56 INFO juju.worker.apicaller [066155] "unit-mysql-test-app-0" successfully connected to "10.152.183.78:17070" unit-mysql-test-app-0: 18:54:56 INFO juju.api cannot resolve "controller-service.controller-microscale.svc.cluster.local": lookup controller-service.controller-microscale.svc.cluster.local: operation was canceled unit-mysql-test-app-0: 18:54:56 INFO juju.api connection established to "wss://10.152.183.78:17070/model/066155ed-0b84-4ae3-83dc-081bafb4d309/api" unit-mysql-test-app-0: 18:54:56 INFO juju.worker.apicaller [066155] "unit-mysql-test-app-0" successfully connected to "10.152.183.78:17070" unit-mysql-test-app-0: 18:54:56 INFO juju.worker.migrationminion migration phase is now: NONE unit-mysql-test-app-0: 18:54:56 INFO juju.worker.logger logger worker started unit-mysql-test-app-0: 18:54:56 WARNING juju.worker.proxyupdater unable to set snap core settings [proxy.http= proxy.https= proxy.store=]: exec: "snap": executable file not found in $PATH, output: "" unit-mysql-test-app-0: 18:54:56 INFO juju.worker.leadership mysql-test-app/0 promoted to leadership of mysql-test-app unit-mysql-test-app-0: 18:54:56 INFO juju.worker.caasupgrader abort check blocked until version event received unit-mysql-test-app-0: 18:54:56 INFO juju.worker.caasupgrader unblocking abort check unit-mysql-test-app-0: 18:54:56 INFO juju.agent.tools ensure jujuc symlinks in /var/lib/juju/tools/unit-mysql-test-app-0 unit-mysql-test-app-0: 18:54:56 INFO juju.worker.uniter unit "mysql-test-app/0" started unit-mysql-test-app-0: 18:54:56 INFO juju.worker.uniter resuming charm install unit-mysql-test-app-0: 18:54:56 INFO juju.worker.uniter.charm downloading ch:amd64/jammy/mysql-test-app-20 from API server unit-mysql-test-app-0: 18:54:56 INFO juju.downloader downloading from ch:amd64/jammy/mysql-test-app-20 unit-mysql-test-app-0: 18:54:56 INFO juju.downloader download complete ("ch:amd64/jammy/mysql-test-app-20") unit-mysql-test-app-0: 18:54:57 INFO juju.downloader download verified ("ch:amd64/jammy/mysql-test-app-20") unit-mysql-k8s-0: 18:54:57 INFO juju.worker.uniter hooks are retried true unit-mysql-k8s-0: 18:54:57 INFO juju.worker.uniter found queued "install" hook unit-mysql-k8s-0: 18:54:59 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:54:59 INFO unit.mysql-k8s/0.juju-log Running legacy hooks/install. unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Charm called itself via hooks/install. unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Legacy hooks/install exited with status 0. unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Using local storage: not a Kubernetes podspec charm unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Initializing SQLite local storage: /var/lib/juju/agents/unit-mysql-k8s-0/charm/.unit-state.db. unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:00 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event install. unit-mysql-router-k8s-0: 18:55:00 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:00 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting Juju event backend_database_relation_created. unit-mysql-router-k8s-0: 18:55:00 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=False, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=None, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:55:00 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set app status to BlockedStatus('Missing relation: database') unit-mysql-router-k8s-0: 18:55:00 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set unit status to ActiveStatus('') unit-mysql-k8s-0: 18:55:00 INFO juju.worker.uniter.operation ran "install" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:01 INFO juju.worker.uniter.operation ran "backend-database-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:01 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:01 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:01 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:01 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-router-k8s-0: 18:55:01 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:01 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:01 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_created. unit-mysql-router-k8s-0: 18:55:01 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting Juju event backend_database_relation_joined. unit-mysql-k8s-0: 18:55:02 INFO juju.worker.uniter.operation ran "database-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:02 INFO juju.worker.uniter.operation ran "backend-database-relation-joined" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:02 INFO juju.worker.uniter hooks are retried true unit-mysql-test-app-0: 18:55:02 INFO juju.worker.uniter found queued "install" hook unit-mysql-router-k8s-0: 18:55:02 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:02 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting Juju event backend_database_relation_changed. unit-mysql-k8s-0: 18:55:02 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:03 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:03 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:03 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:03 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:03 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Emitting Juju event database_peers_relation_created. unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:03 INFO unit.mysql-test-app/0.juju-log Running legacy hooks/install. unit-mysql-router-k8s-0: 18:55:03 INFO juju.worker.uniter.operation ran "backend-database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:03 INFO juju.worker.uniter.operation ran "database-peers-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:03 INFO juju.worker.uniter found queued "leader-elected" hook unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Charm called itself via hooks/install. unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Legacy hooks/install exited with status 0. unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Using local storage: not a Kubernetes podspec charm unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Initializing SQLite local storage: /var/lib/juju/agents/unit-mysql-test-app-0/charm/.unit-state.db. unit-mysql-test-app-0: 18:55:03 DEBUG unit.mysql-test-app/0.juju-log Emitting Juju event install. unit-mysql-test-app-0: 18:55:03 INFO juju.worker.uniter.operation ran "install" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event leader_elected. unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Setting root-password unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Setting server-config-password unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Setting cluster-admin-password unit-mysql-k8s-0: 18:55:04 DEBUG unit.mysql-k8s/0.juju-log Setting monitoring-password unit-mysql-test-app-0: 18:55:04 DEBUG unit.mysql-test-app/0.juju-log application-peers:2: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:04 DEBUG unit.mysql-test-app/0.juju-log application-peers:2: Emitting Juju event application_peers_relation_created. unit-mysql-test-app-0: 18:55:04 INFO juju.worker.uniter.operation ran "application-peers-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:04 INFO juju.worker.uniter found queued "leader-elected" hook unit-mysql-k8s-0: 18:55:04 INFO juju.worker.uniter.operation ran "leader-elected" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:04 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:04 DEBUG unit.mysql-test-app/0.juju-log Emitting Juju event leader_elected. unit-mysql-test-app-0: 18:55:05 INFO juju.worker.uniter.operation ran "leader-elected" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event mysql_pebble_ready. unit-mysql-router-k8s-0: 18:55:05 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log Leader not ready yet, waiting... unit-mysql-router-k8s-0: 18:55:05 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting Juju event database_relation_created. unit-mysql-k8s-0: 18:55:05 DEBUG unit.mysql-k8s/0.juju-log Deferring . unit-mysql-test-app-0: 18:55:05 DEBUG unit.mysql-test-app/0.juju-log database:4: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:05 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting Juju event database_relation_created. unit-mysql-router-k8s-0: 18:55:05 INFO juju.worker.uniter.operation ran "database-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:05 INFO juju.worker.uniter.operation ran "mysql-pebble-ready" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:05 INFO juju.worker.uniter.operation ran "database-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:06 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:06 DEBUG unit.mysql-test-app/0.juju-log Emitting Juju event config_changed. unit-mysql-router-k8s-0: 18:55:06 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:06 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting Juju event database_relation_joined. unit-mysql-test-app-0: 18:55:06 INFO juju.worker.uniter.operation ran "config-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-test-app-0: 18:55:06 INFO juju.worker.uniter found queued "start" hook unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Re-emitting deferred event . unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Leader not ready yet, waiting... unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Deferring . unit-mysql-k8s-0: 18:55:06 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event database_storage_attached. unit-mysql-router-k8s-0: 18:55:06 INFO juju.worker.uniter.operation ran "database-relation-joined" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:06 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:06 INFO unit.mysql-test-app/0.juju-log Running legacy hooks/start. unit-mysql-k8s-0: 18:55:07 INFO juju.worker.uniter.operation ran "database-storage-attached" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:07 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:07 DEBUG unit.mysql-test-app/0.juju-log Charm called itself via hooks/start. unit-mysql-test-app-0: 18:55:07 DEBUG unit.mysql-test-app/0.juju-log Legacy hooks/start exited with status 0. unit-mysql-test-app-0: 18:55:07 DEBUG unit.mysql-test-app/0.juju-log Emitting Juju event start. unit-mysql-router-k8s-0: 18:55:07 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:07 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-test-app-0: 18:55:07 INFO juju.worker.uniter.operation ran "start" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:07 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-test-app-0: 18:55:08 DEBUG unit.mysql-test-app/0.juju-log database:4: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:08 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting Juju event database_relation_joined. unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Re-emitting deferred event . unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Leader not ready yet, waiting... unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Deferring . unit-mysql-k8s-0: 18:55:08 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event config_changed. unit-mysql-test-app-0: 18:55:08 INFO juju.worker.uniter.operation ran "database-relation-joined" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:08 INFO juju.worker.uniter.operation ran "config-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:08 INFO juju.worker.uniter found queued "start" hook unit-mysql-test-app-0: 18:55:08 DEBUG unit.mysql-test-app/0.juju-log database:4: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:08 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-router-k8s-0: 18:55:08 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:09 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-router-k8s-0: 18:55:09 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting custom event . unit-mysql-test-app-0: 18:55:09 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:09 DEBUG unit.mysql-router-k8s/0.juju-log database:4: State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=False, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=None, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:55:09 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Set app status to WaitingStatus('Waiting for related app on endpoint: backend-database') unit-mysql-router-k8s-0: 18:55:09 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Set unit status to ActiveStatus('') unit-mysql-k8s-0: 18:55:09 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:09 INFO unit.mysql-k8s/0.juju-log Running legacy hooks/start. unit-mysql-test-app-0: 18:55:09 DEBUG unit.mysql-test-app/0.juju-log database:4: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:09 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-router-k8s-0: 18:55:09 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:09 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:09 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:09 DEBUG unit.mysql-k8s/0.juju-log Charm called itself via hooks/start. unit-mysql-k8s-0: 18:55:09 DEBUG unit.mysql-k8s/0.juju-log Legacy hooks/start exited with status 0. unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-test-app-0: 18:55:10 DEBUG unit.mysql-test-app/0.juju-log database:4: Operator Framework 2.1.1 up and running. unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log Re-emitting deferred event . unit-mysql-router-k8s-0: 18:55:10 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Operator Framework 2.2.0 up and running. unit-mysql-test-app-0: 18:55:10 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log connection.connect_tcp.complete return_value= unit-mysql-router-k8s-0: 18:55:10 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log connection.start_tls.complete return_value= unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.send_request_body.complete unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'2f36dbd0-85f5-4bb7-a768-dae7d44445e0'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:10 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:10 INFO unit.mysql-k8s/0.juju-log HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.response_closed.started unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log http11.response_closed.complete unit-mysql-k8s-0: 18:55:10 INFO unit.mysql-k8s/0.juju-log Retrieving the total memory of the server unit-mysql-k8s-0: 18:55:10 DEBUG unit.mysql-k8s/0.juju-log Initializing instance unit-mysql-test-app-0: 18:55:10 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:10 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:17 DEBUG unit.mysql-k8s/0.juju-log Adding pebble layer unit-mysql-k8s-0: 18:55:17 DEBUG unit.mysql-k8s/0.juju-log Safe stopping mysqld safe unit-mysql-k8s-0: 18:55:18 DEBUG unit.mysql-k8s/0.juju-log Waiting for instance to be ready unit-mysql-k8s-0: 18:55:23 INFO unit.mysql-k8s/0.juju-log Configuring instance unit-mysql-k8s-0: 18:55:23 DEBUG unit.mysql-k8s/0.juju-log Configuring users unit-mysql-k8s-0: 18:55:23 DEBUG unit.mysql-k8s/0.juju-log Configuring instance for InnoDB on mysql-k8s-0.mysql-k8s-endpoints unit-mysql-k8s-0: 18:55:30 DEBUG unit.mysql-k8s/0.juju-log Getting InnoDB version unit-mysql-k8s-0: 18:55:30 INFO unit.mysql-k8s/0.juju-log Creating cluster on the leader unit unit-mysql-k8s-0: 18:55:30 DEBUG unit.mysql-k8s/0.juju-log Creating a MySQL InnoDB cluster on mysql-k8s-0.mysql-k8s-endpoints unit-mysql-k8s-0: 18:55:33 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event start. unit-mysql-k8s-0: 18:55:33 DEBUG unit.mysql-k8s/0.juju-log Alert rules path does not exist: src/prometheus_alert_rules unit-mysql-k8s-0: 18:55:33 INFO juju.worker.uniter.operation ran "start" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Emitting Juju event database_peers_relation_changed. unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: Updating pod labels unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: connection.connect_tcp.complete return_value= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: connection.start_tls.complete return_value= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'95fc1a01-dcb0-41c9-85b0-60462f068f18'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:34 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:34 INFO unit.mysql-k8s/0.juju-log database-peers:1: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.response_closed.started unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.response_closed.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'0825ed03-723a-4f9b-90e5-da707911a6ec'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:34 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:34 INFO unit.mysql-k8s/0.juju-log database-peers:1: HTTP Request: PATCH https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.response_closed.started unit-mysql-k8s-0: 18:55:34 DEBUG unit.mysql-k8s/0.juju-log database-peers:1: http11.response_closed.complete unit-mysql-k8s-0: 18:55:34 INFO unit.mysql-k8s/0.juju-log database-peers:1: Kubernetes pod label primary created unit-mysql-k8s-0: 18:55:35 INFO juju.worker.uniter.operation ran "database-peers-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_changed. unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting custom event . unit-mysql-k8s-0: 18:55:35 DEBUG unit.mysql-k8s/0.juju-log database:3: Getting InnoDB version unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: Updating pod labels unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.connect_tcp.complete return_value= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.start_tls.complete return_value= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'29810ded-4471-42fb-a702-14b56a29f27b'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:36 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'bbda4fec-8867-4840-9da8-2633f5450b03'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:36 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: PATCH https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: Kubernetes pod label primary created unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'58091a44-f01b-4bfa-9c9f-e3e69a09861f'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:36 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 201, b'Created', [(b'Audit-Id', b'37f57d50-c485-4fe1-a62b-3a24db1c73c4'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:36 GMT'), (b'Content-Length', b'1267')]) unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: POST https://10.152.183.1/api/v1/namespaces/foo4/services "HTTP/1.1 201 Created" unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: Kubernetes service mysql-k8s-primary created unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'867f007a-ac93-4ebf-b57c-836c15849dc2'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:36 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-k8s-0 "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 201, b'Created', [(b'Audit-Id', b'3d9469ec-5f5f-410a-b0d4-d5e3b584a594'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:55:36 GMT'), (b'Content-Length', b'1271')]) unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: POST https://10.152.183.1/api/v1/namespaces/foo4/services "HTTP/1.1 201 Created" unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:55:36 INFO unit.mysql-k8s/0.juju-log database:3: Kubernetes service mysql-k8s-replicas created unit-mysql-k8s-0: 18:55:36 DEBUG unit.mysql-k8s/0.juju-log database:3: Kubernetes service endpoint not ready yet unit-mysql-k8s-0: 18:55:37 DEBUG unit.mysql-k8s/0.juju-log database:3: Kubernetes service endpoint not ready yet unit-mysql-k8s-0: 18:55:38 DEBUG unit.mysql-k8s/0.juju-log database:3: Kubernetes service endpoint not ready yet unit-mysql-k8s-0: 18:55:39 DEBUG unit.mysql-k8s/0.juju-log database:3: Kubernetes service endpoint not ready yet unit-mysql-k8s-0: 18:55:40 DEBUG unit.mysql-k8s/0.juju-log database:3: Kubernetes service endpoint ready unit-mysql-k8s-0: 18:55:40 DEBUG unit.mysql-k8s/0.juju-log database:3: Getting cluster primary member's address from mysql-k8s-0.mysql-k8s-endpoints unit-mysql-k8s-0: 18:55:41 DEBUG unit.mysql-k8s/0.juju-log database:3: Getting cluster primary member's address from mysql-k8s-0.mysql-k8s-endpoints unit-mysql-k8s-0: 18:55:42 INFO unit.mysql-k8s/0.juju-log database:3: Created user for app mysql-router-k8s unit-mysql-k8s-0: 18:55:42 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:43 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:43 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:43 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:43 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:43 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:43 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_joined. unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting Juju event backend_database_relation_changed. unit-mysql-router-k8s-0: 18:55:43 INFO unit.mysql-router-k8s/0.juju-log backend-database:3: database created at 2023-05-25 18:55:43.339150 unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting custom event . unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=True, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=False, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Reconciling users event=, router_endpoint='mysql-router-k8s.foo4.svc.cluster.local' unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: State of reconcile users requested_users=[_Relation(_relation=, _interface=)], created_users=[] unit-mysql-router-k8s-0: 18:55:43 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Creating database='continuous_writes_database' and username='relation-3-4' with attributes='{"created_by_user": "relation-3"}' unit-mysql-k8s-0: 18:55:43 INFO juju.worker.uniter.operation ran "database-relation-joined" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:44 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:44 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:44 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:44 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:44 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:44 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_changed. unit-mysql-router-k8s-0: 18:55:44 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Created database='continuous_writes_database' and username='relation-3-4' with attributes='{"created_by_user": "relation-3"}' unit-mysql-router-k8s-0: 18:55:44 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Setting databag self.id=4 self._database='continuous_writes_database', username='relation-3-4', read_write_endpoint='mysql-router-k8s.foo4.svc.cluster.local:6446', read_only_endpoint='mysql-router-k8s.foo4.svc.cluster.local:6447' unit-mysql-router-k8s-0: 18:55:44 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set databag self.id=4 self._database='continuous_writes_database', username='relation-3-4', read_write_endpoint='mysql-router-k8s.foo4.svc.cluster.local:6446', read_only_endpoint='mysql-router-k8s.foo4.svc.cluster.local:6447' unit-mysql-router-k8s-0: 18:55:44 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Reconciled users event=, router_endpoint='mysql-router-k8s.foo4.svc.cluster.local' unit-mysql-router-k8s-0: 18:55:44 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Enabling MySQL Router service unit-mysql-router-k8s-0: 18:55:44 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Bootstrapping router tls=False, self._database_requires_relation.host='mysql-k8s-primary.foo4.svc.cluster.local', self._database_requires_relation.port='3306' unit-mysql-k8s-0: 18:55:44 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Bootstrapped router tls=False, self._database_requires_relation.host='mysql-k8s-primary.foo4.svc.cluster.local', self._database_requires_relation.port='3306' unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Adding attributes='{"created_by_user": "relation-3", "router_id": "mysql-router-k8s-0.mysql-router-k8s-endpoints.foo4.svc.cluster.local::system", "created_by_juju_unit": "mysql-router-k8s/0"}' to username='mysql_router1_4bjsis3fgj5x' unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Added attributes='{"created_by_user": "relation-3", "router_id": "mysql-router-k8s-0.mysql-router-k8s-endpoints.foo4.svc.cluster.local::system", "created_by_juju_unit": "mysql-router-k8s/0"}' to username='mysql_router1_4bjsis3fgj5x' unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Enabled MySQL Router service unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Waiting until MySQL Router is ready unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: MySQL Router is ready unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set app status to ActiveStatus('') unit-mysql-router-k8s-0: 18:55:46 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set unit status to ActiveStatus('') unit-mysql-router-k8s-0: 18:55:46 INFO juju.worker.uniter.operation ran "backend-database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:47 DEBUG unit.mysql-test-app/0.juju-log database:4: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:47 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-test-app-0: 18:55:47 INFO unit.mysql-test-app/0.juju-log database:4: database created at 2023-05-25 18:55:47.210633 unit-mysql-test-app-0: 18:55:47 DEBUG unit.mysql-test-app/0.juju-log database:4: Emitting custom event . unit-mysql-k8s-0: 18:55:47 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:55:47 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:55:47 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:55:47 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:55:47 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-test-app-0: 18:55:47 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:55:47 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_changed. unit-mysql-k8s-0: 18:55:47 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:47 DEBUG unit.mysql-test-app/0.juju-log application-peers:2: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:47 DEBUG unit.mysql-test-app/0.juju-log application-peers:2: Emitting Juju event application_peers_relation_changed. unit-mysql-test-app-0: 18:55:48 INFO unit.mysql-test-app/0.juju-log application-peers:2: Started continuous writes unit-mysql-test-app-0: 18:55:48 INFO unit.mysql-test-app/0.juju-log application-peers:2: Wrote random_value unit-mysql-router-k8s-0: 18:55:48 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:55:48 DEBUG unit.mysql-router-k8s/0.juju-log database:4: Emitting Juju event database_relation_changed. unit-mysql-test-app-0: 18:55:48 INFO juju.worker.uniter.operation ran "application-peers-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:55:48 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 18:55:48 DEBUG unit.mysql-test-app/0.juju-log application-peers:2: Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 18:55:48 DEBUG unit.mysql-test-app/0.juju-log application-peers:2: Emitting Juju event application_peers_relation_changed. unit-mysql-test-app-0: 18:55:49 INFO juju.worker.uniter.operation ran "application-peers-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:56:29 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:56:29 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting Juju event backend_database_relation_departed. unit-mysql-k8s-0: 18:56:29 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:56:29 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:56:29 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:56:29 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:56:29 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:56:29 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_departed. unit-mysql-router-k8s-0: 18:56:29 INFO juju.worker.uniter.operation ran "backend-database-relation-departed" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:56:30 DEBUG unit.mysql-k8s/0.juju-log database:3: Getting cluster primary member's address from mysql-k8s-0.mysql-k8s-endpoints unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Emitting Juju event backend_database_relation_broken. unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=True, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=True, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Reconciling users event=, router_endpoint='mysql-router-k8s.foo4.svc.cluster.local' unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: State of reconcile users requested_users=[_Relation(_relation=, _interface=)], created_users=[_Relation(_relation=, _interface=)] unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Reconciled users event=, router_endpoint='mysql-router-k8s.foo4.svc.cluster.local' unit-mysql-router-k8s-0: 18:56:30 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Disabling MySQL Router service unit-mysql-k8s-0: 18:56:30 INFO unit.mysql-k8s/0.juju-log database:3: Deleted router user mysql_router1_4bjsis3fgj5x unit-mysql-k8s-0: 18:56:30 DEBUG unit.mysql-k8s/0.juju-log database:3: Getting cluster primary member's address from mysql-k8s-0.mysql-k8s-endpoints unit-mysql-k8s-0: 18:56:31 INFO unit.mysql-k8s/0.juju-log database:3: Removed router from metadata mysql-router-k8s-0.mysql-router-k8s-endpoints.foo4.svc.cluster.local::system unit-mysql-router-k8s-0: 18:56:31 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Disabled MySQL Router service unit-mysql-router-k8s-0: 18:56:31 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set app status to BlockedStatus('Missing relation: backend-database') unit-mysql-router-k8s-0: 18:56:31 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:3: Set unit status to ActiveStatus('') unit-mysql-k8s-0: 18:56:32 INFO juju.worker.uniter.operation ran "database-relation-departed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:56:32 INFO juju.worker.uniter.operation ran "backend-database-relation-broken" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: Emitting Juju event database_relation_broken. unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.connect_tcp.complete return_value= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: connection.start_tls.complete return_value= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'ba35109f-51f5-4212-a1f4-b5fd5aab1065'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:56:32 GMT'), (b'Content-Length', b'1267')]) unit-mysql-k8s-0: 18:56:32 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: DELETE https://10.152.183.1/api/v1/namespaces/foo4/services/mysql-k8s-primary "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:56:32 INFO unit.mysql-k8s/0.juju-log database:3: Kubernetes service mysql-k8s-primary deleted unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.started request= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_headers.complete unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.started request= unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.send_request_body.complete unit-mysql-k8s-0: 18:56:32 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.started request= unit-mysql-k8s-0: 18:56:33 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'9bded2fc-d54c-493c-8679-ae7950d1c9a2'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:56:32 GMT'), (b'Content-Length', b'1271')]) unit-mysql-k8s-0: 18:56:33 INFO unit.mysql-k8s/0.juju-log database:3: HTTP Request: DELETE https://10.152.183.1/api/v1/namespaces/foo4/services/mysql-k8s-replicas "HTTP/1.1 200 OK" unit-mysql-k8s-0: 18:56:33 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.started request= unit-mysql-k8s-0: 18:56:33 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.receive_response_body.complete unit-mysql-k8s-0: 18:56:33 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.started unit-mysql-k8s-0: 18:56:33 DEBUG unit.mysql-k8s/0.juju-log database:3: http11.response_closed.complete unit-mysql-k8s-0: 18:56:33 INFO unit.mysql-k8s/0.juju-log database:3: Kubernetes service mysql-k8s-replicas deleted unit-mysql-k8s-0: 18:56:33 DEBUG unit.mysql-k8s/0.juju-log database:3: Getting cluster primary member's address from mysql-k8s-0.mysql-k8s-endpoints unit-mysql-k8s-0: 18:56:33 INFO unit.mysql-k8s/0.juju-log database:3: Removed user(s) for relation 3 unit-mysql-k8s-0: 18:56:34 INFO juju.worker.uniter.operation ran "database-relation-broken" hook (via hook dispatching script: dispatch) controller-0: 18:56:40 INFO juju.worker.caasapplicationprovisioner.runner start "mysql-2nd-k8s" controller-0: 18:56:40 INFO juju.worker.caasapplicationprovisioner.mysql-2nd-k8s scaling application "mysql-2nd-k8s" to desired scale 1 controller-0: 18:56:40 INFO juju.worker.caasapplicationprovisioner.mysql-2nd-k8s scaling application "mysql-2nd-k8s" to desired scale 1 controller-0: 18:56:44 INFO juju.worker.caasapplicationprovisioner.mysql-2nd-k8s scaling application "mysql-2nd-k8s" to desired scale 1 unit-mysql-router-k8s-0: 18:56:48 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:56:48 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Emitting Juju event backend_database_relation_created. unit-mysql-router-k8s-0: 18:56:48 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=False, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=None, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:56:48 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Set app status to WaitingStatus('Waiting for related app on endpoint: backend-database') unit-mysql-router-k8s-0: 18:56:48 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Set unit status to ActiveStatus('') unit-mysql-router-k8s-0: 18:56:48 INFO juju.worker.uniter.operation ran "backend-database-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.cmd running containerAgent [2.9.43 8ae2c6e22e285d4fe326902202e955dd3fff4384 gc go1.20.3] unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.cmd.containeragent.unit start "unit" unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.upgradesteps upgrade steps for 2.9.43 have already been run. unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.probehttpserver starting http server on [::]:65301 unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.api connection established to "wss://controller-service.controller-microscale.svc.cluster.local:17070/model/066155ed-0b84-4ae3-83dc-081bafb4d309/api" unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.apicaller [066155] "unit-mysql-2nd-k8s-0" successfully connected to "controller-service.controller-microscale.svc.cluster.local:17070" unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.migrationminion migration phase is now: NONE unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.logger logger worker started unit-mysql-2nd-k8s-0: 18:56:51 WARNING juju.worker.proxyupdater unable to set snap core settings [proxy.http= proxy.https= proxy.store=]: exec: "snap": executable file not found in $PATH, output: "" unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.leadership mysql-2nd-k8s/0 promoted to leadership of mysql-2nd-k8s unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.caasupgrader abort check blocked until version event received unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.caasupgrader unblocking abort check unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.agent.tools ensure jujuc symlinks in /var/lib/juju/tools/unit-mysql-2nd-k8s-0 unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.uniter unit "mysql-2nd-k8s/0" started unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.uniter resuming charm install unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.worker.uniter.charm downloading ch:amd64/jammy/mysql-k8s-82 from API server unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.downloader downloading from ch:amd64/jammy/mysql-k8s-82 unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.downloader download complete ("ch:amd64/jammy/mysql-k8s-82") unit-mysql-2nd-k8s-0: 18:56:51 INFO juju.downloader download verified ("ch:amd64/jammy/mysql-k8s-82") unit-mysql-2nd-k8s-0: 18:57:03 INFO juju.worker.uniter hooks are retried true unit-mysql-2nd-k8s-0: 18:57:03 INFO juju.worker.uniter found queued "install" hook unit-mysql-2nd-k8s-0: 18:57:04 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:04 INFO unit.mysql-2nd-k8s/0.juju-log Running legacy hooks/install. unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Charm called itself via hooks/install. unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Legacy hooks/install exited with status 0. unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Using local storage: not a Kubernetes podspec charm unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Initializing SQLite local storage: /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/.unit-state.db. unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:05 DEBUG unit.mysql-2nd-k8s/0.juju-log Emitting Juju event install. unit-mysql-2nd-k8s-0: 18:57:05 INFO juju.worker.uniter.operation ran "install" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:06 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:06 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:06 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-router-k8s-0: 18:57:06 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:06 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:06 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:06 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Emitting Juju event database_peers_relation_created. unit-mysql-router-k8s-0: 18:57:06 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Emitting Juju event backend_database_relation_joined. unit-mysql-2nd-k8s-0: 18:57:07 INFO juju.worker.uniter.operation ran "database-peers-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:57:07 INFO juju.worker.uniter.operation ran "backend-database-relation-joined" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:57:07 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:57:07 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Emitting Juju event backend_database_relation_changed. unit-mysql-2nd-k8s-0: 18:57:07 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:07 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:07 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:07 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:07 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:07 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Emitting Juju event database_relation_created. unit-mysql-router-k8s-0: 18:57:08 INFO juju.worker.uniter.operation ran "backend-database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:08 INFO juju.worker.uniter.operation ran "database-relation-created" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:08 INFO juju.worker.uniter found queued "leader-elected" hook unit-mysql-2nd-k8s-0: 18:57:08 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Emitting Juju event leader_elected. unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Setting root-password unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Setting server-config-password unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Setting cluster-admin-password unit-mysql-2nd-k8s-0: 18:57:09 DEBUG unit.mysql-2nd-k8s/0.juju-log Setting monitoring-password unit-mysql-2nd-k8s-0: 18:57:09 INFO juju.worker.uniter.operation ran "leader-elected" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log Emitting Juju event mysql_pebble_ready. unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log Leader not ready yet, waiting... unit-mysql-2nd-k8s-0: 18:57:10 DEBUG unit.mysql-2nd-k8s/0.juju-log Deferring . unit-mysql-2nd-k8s-0: 18:57:10 INFO juju.worker.uniter.operation ran "mysql-pebble-ready" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Re-emitting deferred event . unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Leader not ready yet, waiting... unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Deferring . unit-mysql-2nd-k8s-0: 18:57:11 DEBUG unit.mysql-2nd-k8s/0.juju-log Emitting Juju event database_storage_attached. unit-mysql-2nd-k8s-0: 18:57:11 INFO juju.worker.uniter.operation ran "database-storage-attached" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Re-emitting deferred event . unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Leader not ready yet, waiting... unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Deferring . unit-mysql-2nd-k8s-0: 18:57:12 DEBUG unit.mysql-2nd-k8s/0.juju-log Emitting Juju event config_changed. unit-mysql-2nd-k8s-0: 18:57:12 INFO juju.worker.uniter.operation ran "config-changed" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:12 INFO juju.worker.uniter found queued "start" hook unit-mysql-2nd-k8s-0: 18:57:13 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:13 INFO unit.mysql-2nd-k8s/0.juju-log Running legacy hooks/start. unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Charm called itself via hooks/start. unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Legacy hooks/start exited with status 0. unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Re-emitting deferred event . unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log connection.connect_tcp.complete return_value= unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log connection.start_tls.complete return_value= unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'63c636aa-62be-4ffa-aace-c57de431e7d4'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:14 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:14 INFO unit.mysql-2nd-k8s/0.juju-log HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:14 INFO unit.mysql-2nd-k8s/0.juju-log Retrieving the total memory of the server unit-mysql-2nd-k8s-0: 18:57:14 DEBUG unit.mysql-2nd-k8s/0.juju-log Initializing instance unit-mysql-2nd-k8s-0: 18:57:22 DEBUG unit.mysql-2nd-k8s/0.juju-log Adding pebble layer unit-mysql-2nd-k8s-0: 18:57:22 DEBUG unit.mysql-2nd-k8s/0.juju-log Safe stopping mysqld safe unit-mysql-2nd-k8s-0: 18:57:23 DEBUG unit.mysql-2nd-k8s/0.juju-log Waiting for instance to be ready unit-mysql-2nd-k8s-0: 18:57:28 INFO unit.mysql-2nd-k8s/0.juju-log Configuring instance unit-mysql-2nd-k8s-0: 18:57:28 DEBUG unit.mysql-2nd-k8s/0.juju-log Configuring users unit-mysql-2nd-k8s-0: 18:57:28 DEBUG unit.mysql-2nd-k8s/0.juju-log Configuring instance for InnoDB on mysql-2nd-k8s-0.mysql-2nd-k8s-endpoints unit-mysql-2nd-k8s-0: 18:57:35 DEBUG unit.mysql-2nd-k8s/0.juju-log Getting InnoDB version unit-mysql-2nd-k8s-0: 18:57:35 INFO unit.mysql-2nd-k8s/0.juju-log Creating cluster on the leader unit unit-mysql-2nd-k8s-0: 18:57:35 DEBUG unit.mysql-2nd-k8s/0.juju-log Creating a MySQL InnoDB cluster on mysql-2nd-k8s-0.mysql-2nd-k8s-endpoints unit-mysql-2nd-k8s-0: 18:57:38 DEBUG unit.mysql-2nd-k8s/0.juju-log Emitting Juju event start. unit-mysql-2nd-k8s-0: 18:57:38 DEBUG unit.mysql-2nd-k8s/0.juju-log Alert rules path does not exist: src/prometheus_alert_rules unit-mysql-2nd-k8s-0: 18:57:38 INFO juju.worker.uniter.operation ran "start" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Emitting Juju event database_peers_relation_changed. unit-mysql-2nd-k8s-0: 18:57:39 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Updating pod labels unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.connect_tcp.complete return_value= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.start_tls.complete return_value= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'c8afb412-8ec1-4e59-8fe4-567e66bfdd45'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:40 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:40 INFO unit.mysql-2nd-k8s/0.juju-log database-peers:5: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'f0919f60-8dd9-48ac-ab0a-81e72a03bb7d'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:40 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:40 INFO unit.mysql-2nd-k8s/0.juju-log database-peers:5: HTTP Request: PATCH https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:40 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:40 INFO unit.mysql-2nd-k8s/0.juju-log database-peers:5: Kubernetes pod label primary created unit-mysql-2nd-k8s-0: 18:57:40 INFO juju.worker.uniter.operation ran "database-peers-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Emitting Juju event database_peers_relation_changed. unit-mysql-2nd-k8s-0: 18:57:41 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: Updating pod labels unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.connect_tcp.complete return_value= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: connection.start_tls.complete return_value= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'5d5ee99e-d9ca-4f48-bf5a-fb98c9cc2aa8'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:42 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:42 INFO unit.mysql-2nd-k8s/0.juju-log database-peers:5: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'4142b9f7-b4b3-459f-9f6d-52921c059d6d'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:42 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:42 INFO unit.mysql-2nd-k8s/0.juju-log database-peers:5: HTTP Request: PATCH https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:42 DEBUG unit.mysql-2nd-k8s/0.juju-log database-peers:5: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:42 INFO unit.mysql-2nd-k8s/0.juju-log database-peers:5: Kubernetes pod label primary created unit-mysql-2nd-k8s-0: 18:57:42 INFO juju.worker.uniter.operation ran "database-peers-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Emitting Juju event database_relation_changed. unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Emitting custom event . unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Getting InnoDB version unit-mysql-2nd-k8s-0: 18:57:43 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Updating pod labels unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: connection.connect_tcp.started host='10.152.183.1' port=443 local_address=None timeout=None unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: connection.connect_tcp.complete return_value= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: connection.start_tls.started ssl_context= server_hostname='10.152.183.1' timeout=None unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: connection.start_tls.complete return_value= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'd7e63d43-1ce4-498b-a9fa-ded2f5a3af76'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:44 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'b593a161-04ea-4eef-8964-967f42bab7cf'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:44 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: HTTP Request: PATCH https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: Kubernetes pod label primary created unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'dddf2ba0-2ea4-42e4-ad32-e96f102b6333'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:44 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 201, b'Created', [(b'Audit-Id', b'3dd7ae2a-ee96-4879-8009-9e1f73a6b2a6'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:44 GMT'), (b'Content-Length', b'1281')]) unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: HTTP Request: POST https://10.152.183.1/api/v1/namespaces/foo4/services "HTTP/1.1 201 Created" unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: Kubernetes service mysql-2nd-k8s-primary created unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Audit-Id', b'15f197d0-9b9e-4c8e-9c48-b2f361b4b0df'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:44 GMT'), (b'Transfer-Encoding', b'chunked')]) unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: HTTP Request: GET https://10.152.183.1/api/v1/namespaces/foo4/pods/mysql-2nd-k8s-0 "HTTP/1.1 200 OK" unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_headers.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.send_request_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_headers.complete return_value=(b'HTTP/1.1', 201, b'Created', [(b'Audit-Id', b'e0a8ed1d-6c50-48a5-addd-ce39aae5fb4f'), (b'Cache-Control', b'no-cache, private'), (b'Content-Type', b'application/json'), (b'X-Kubernetes-Pf-Flowschema-Uid', b'd178a7e5-16a6-4c1d-b375-269b5c847538'), (b'X-Kubernetes-Pf-Prioritylevel-Uid', b'6aafa5ee-718d-41e3-ac79-a7986543b90b'), (b'Date', b'Thu, 25 May 2023 18:57:44 GMT'), (b'Content-Length', b'1281')]) unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: HTTP Request: POST https://10.152.183.1/api/v1/namespaces/foo4/services "HTTP/1.1 201 Created" unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.started request= unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.receive_response_body.complete unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.started unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: http11.response_closed.complete unit-mysql-2nd-k8s-0: 18:57:44 INFO unit.mysql-2nd-k8s/0.juju-log database:6: Kubernetes service mysql-2nd-k8s-replicas created unit-mysql-2nd-k8s-0: 18:57:44 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Kubernetes service endpoint not ready yet unit-mysql-2nd-k8s-0: 18:57:45 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Kubernetes service endpoint ready unit-mysql-2nd-k8s-0: 18:57:45 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Getting cluster primary member's address from mysql-2nd-k8s-0.mysql-2nd-k8s-endpoints unit-mysql-2nd-k8s-0: 18:57:46 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Getting cluster primary member's address from mysql-2nd-k8s-0.mysql-2nd-k8s-endpoints unit-mysql-2nd-k8s-0: 18:57:47 INFO unit.mysql-2nd-k8s/0.juju-log database:6: Created user for app mysql-router-k8s unit-mysql-2nd-k8s-0: 18:57:48 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:48 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:48 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:48 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:48 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:48 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:48 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Emitting Juju event database_relation_joined. unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Emitting Juju event backend_database_relation_changed. unit-mysql-router-k8s-0: 18:57:49 INFO unit.mysql-router-k8s/0.juju-log backend-database:6: database created at 2023-05-25 18:57:49.177961 unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Emitting custom event . unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: State of reconcile self.unit.is_leader()=True, isinstance(self.workload, workload.AuthenticatedWorkload)=True, self.database_requires.relation and self.database_requires.relation.is_breaking(event)=False, self.workload.container_ready=True, isinstance(event, ops.UpgradeCharmEvent)=False unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Reconciling users event=, router_endpoint='mysql-router-k8s.foo4.svc.cluster.local' unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: State of reconcile users requested_users=[_Relation(_relation=, _interface=)], created_users=[_Relation(_relation=, _interface=)] unit-mysql-2nd-k8s-0: 18:57:49 INFO juju.worker.uniter.operation ran "database-relation-joined" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Reconciled users event=, router_endpoint='mysql-router-k8s.foo4.svc.cluster.local' unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Enabling MySQL Router service unit-mysql-router-k8s-0: 18:57:49 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Bootstrapping router tls=False, self._database_requires_relation.host='mysql-2nd-k8s-primary.foo4.svc.cluster.local', self._database_requires_relation.port='3306' unit-mysql-2nd-k8s-0: 18:57:50 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:50 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:50 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:50 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:50 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:50 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Emitting Juju event database_relation_changed. unit-mysql-2nd-k8s-0: 18:57:50 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Bootstrapped router tls=False, self._database_requires_relation.host='mysql-2nd-k8s-primary.foo4.svc.cluster.local', self._database_requires_relation.port='3306' unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Adding attributes='{"created_by_user": "relation-6", "router_id": "mysql-router-k8s-0.mysql-router-k8s-endpoints.foo4.svc.cluster.local::system", "created_by_juju_unit": "mysql-router-k8s/0"}' to username='mysql_router1_6njexh8bewn6' unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Added attributes='{"created_by_user": "relation-6", "router_id": "mysql-router-k8s-0.mysql-router-k8s-endpoints.foo4.svc.cluster.local::system", "created_by_juju_unit": "mysql-router-k8s/0"}' to username='mysql_router1_6njexh8bewn6' unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Enabled MySQL Router service unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Waiting until MySQL Router is ready unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: MySQL Router is ready unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Set app status to ActiveStatus('') unit-mysql-router-k8s-0: 18:57:51 DEBUG unit.mysql-router-k8s/0.juju-log backend-database:6: Set unit status to ActiveStatus('') unit-mysql-router-k8s-0: 18:57:51 INFO juju.worker.uniter.operation ran "backend-database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-2nd-k8s-0: 18:57:52 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Operator Framework 2.2.0 up and running. unit-mysql-2nd-k8s-0: 18:57:52 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-2nd-k8s-0: 18:57:52 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-2nd-k8s-0: 18:57:52 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:52 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-2nd-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-2nd-k8s-0: 18:57:52 DEBUG unit.mysql-2nd-k8s/0.juju-log database:6: Emitting Juju event database_relation_changed. unit-mysql-2nd-k8s-0: 18:57:52 INFO juju.worker.uniter.operation ran "database-relation-changed" hook (via hook dispatching script: dispatch) unit-mysql-router-k8s-0: 18:59:09 DEBUG unit.mysql-router-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-router-k8s-0: 18:59:09 DEBUG unit.mysql-router-k8s/0.juju-log Emitting Juju event update_status. unit-mysql-router-k8s-0: 18:59:09 WARNING unit.mysql-router-k8s/0.juju-log No relation: certificates unit-mysql-router-k8s-0: 18:59:09 INFO juju.worker.uniter.operation ran "update-status" hook (via hook dispatching script: dispatch) unit-mysql-k8s-0: 18:59:11 DEBUG unit.mysql-k8s/0.juju-log Operator Framework 2.2.0 up and running. unit-mysql-k8s-0: 18:59:11 DEBUG unit.mysql-k8s/0.juju-log load_ssl_context verify='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' cert=None trust_env=True http2=False unit-mysql-k8s-0: 18:59:11 DEBUG unit.mysql-k8s/0.juju-log load_verify_locations cafile='/var/run/secrets/kubernetes.io/serviceaccount/ca.crt' unit-mysql-k8s-0: 18:59:11 DEBUG unit.mysql-k8s/0.juju-log Invalid Prometheus alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/prometheus_alert_rules: directory does not exist unit-mysql-k8s-0: 18:59:11 DEBUG unit.mysql-k8s/0.juju-log Invalid Loki alert rules folder at /var/lib/juju/agents/unit-mysql-k8s-0/charm/src/loki_alert_rules: directory does not exist unit-mysql-k8s-0: 18:59:11 DEBUG unit.mysql-k8s/0.juju-log Emitting Juju event update_status. unit-mysql-k8s-0: 18:59:11 INFO unit.mysql-k8s/0.juju-log Unit workload member-state is online with member-role primary unit-mysql-k8s-0: 18:59:12 WARNING unit.mysql-k8s/0.juju-log No relation: certificates unit-mysql-k8s-0: 18:59:12 INFO juju.worker.uniter.operation ran "update-status" hook (via hook dispatching script: dispatch) unit-mysql-test-app-0: 19:00:45 DEBUG unit.mysql-test-app/0.juju-log Operator Framework 2.1.1 up and running. unit-mysql-test-app-0: 19:00:45 DEBUG unit.mysql-test-app/0.juju-log Emitting Juju event update_status. unit-mysql-test-app-0: 19:00:45 INFO juju.worker.uniter.operation ran "update-status" hook (via hook dispatching script: dispatch) ```