truecharts / public

Community Helm Chart Repository
https://truecharts.org
GNU Affero General Public License v3.0
1.14k stars 617 forks source link

[home-assistant] stops deploying after pgbouncer starts #11149

Closed qraynaud closed 1 year ago

qraynaud commented 1 year ago

App Name

home-assistant

SCALE Version

22.12.2

App Version

2023.7.3_20.0.0

Application Events

2023-08-02 13:24:39
Container image "ghcr.io/cloudnative-pg/pgbouncer:1.19.1" already present on machine
2023-08-02 13:24:39
Created container pgbouncer
2023-08-02 13:24:39
Started container pgbouncer
2023-08-02 13:24:38
Started container home-assistant-system-cnpg-wait
2023-08-02 13:24:38
Started container bootstrap-controller
2023-08-02 13:24:37
Created container home-assistant-system-cnpg-wait
2023-08-02 13:24:37
Created container bootstrap-controller
2023-08-02 13:24:36
Add eth0 [172.16.1.39/16] from ix-net
2023-08-02 13:24:36
Container image "tccr.io/truecharts/cloudnative-pg:v1.20.2@sha256:07121d674c1de587044746f92cc3bccb4576f2fc125f6f2f5bcaa582dad3e3ad" already present on machine
2023-08-02 13:24:35
Add eth0 [172.16.1.38/16] from ix-net
2023-08-02 13:24:35
Scaled up replica set home-assistant-cnpg-main-rw-59ff55d4c5 to 1 from 0
2023-08-02 13:24:35
Created pod: home-assistant-cnpg-main-rw-59ff55d4c5-g2hf8
2023-08-02 13:24:35
Successfully assigned ix-home-assistant/home-assistant-cnpg-main-rw-59ff55d4c5-g2hf8 to ix-truenas
2023-08-02 13:24:35
Add net1 [192.168.50.251/24] from ix-home-assistant/ix-home-assistant-0
2023-08-02 13:24:35
Container image "tccr.io/truecharts/db-wait-postgres:1.1.0@sha256:a163c7836d7bb436a428f5d55bbba0eb73bcdb9bc202047e2523bbb539c113e6" already present on machine
2023-08-02 13:24:34
Scaled up replica set home-assistant-6c865f9757 to 1
2023-08-02 13:24:34
Created pod: home-assistant-6c865f9757-tvhsq
2023-08-02 13:24:34
Successfully assigned ix-home-assistant/home-assistant-6c865f9757-tvhsq to ix-truenas
2023-08-02 13:21:30
Started container home-assistant-system-cnpg-wait
2023-08-02 13:21:30
Stopping container home-assistant-system-cnpg-wait
2023-08-02 13:21:29
Created container home-assistant-system-cnpg-wait
2023-08-02 13:21:28
Started container bootstrap-controller
2023-08-02 13:21:28
Started container bootstrap-controller
2023-08-02 13:21:27
Add eth0 [172.16.1.35/16] from ix-net
2023-08-02 13:21:27
Container image "tccr.io/truecharts/cloudnative-pg:v1.20.2@sha256:07121d674c1de587044746f92cc3bccb4576f2fc125f6f2f5bcaa582dad3e3ad" already present on machine
2023-08-02 13:21:27
Add eth0 [172.16.1.36/16] from ix-net
2023-08-02 13:21:27
Container image "tccr.io/truecharts/cloudnative-pg:v1.20.2@sha256:07121d674c1de587044746f92cc3bccb4576f2fc125f6f2f5bcaa582dad3e3ad" already present on machine
2023-08-02 13:21:27
Add eth0 [172.16.1.37/16] from ix-net
2023-08-02 13:21:27
Add net1 [192.168.50.251/24] from ix-home-assistant/ix-home-assistant-0
2023-08-02 13:21:27
Container image "tccr.io/truecharts/db-wait-postgres:1.1.0@sha256:a163c7836d7bb436a428f5d55bbba0eb73bcdb9bc202047e2523bbb539c113e6" already present on machine
2023-08-02 13:21:27
Created container bootstrap-controller
2023-08-02 13:21:27
Created container bootstrap-controller

Application Logs

pg bouncer :
=====
2023-08-02 11:24:39.868752+00:00{"level":"info","ts":"2023-08-02T11:24:39Z","msg":"Starting CloudNativePG PgBouncer Instance Manager","version":"1.20.2","build":{"Version":"1.20.2","Commit":"6f7f10b7","Date":"2023-07-27"}}
2023-08-02 11:24:39.914756+00:00{"level":"info","ts":"2023-08-02T11:24:39Z","msg":"updated configuration file","name":"/controller/configs/server-tls/tls.crt"}
2023-08-02 11:24:39.944121+00:00{"level":"info","ts":"2023-08-02T11:24:39Z","msg":"updated configuration file","name":"/controller/configs/server-tls/tls.key"}
2023-08-02 11:24:39.966601+00:00{"level":"info","ts":"2023-08-02T11:24:39Z","msg":"updated configuration file","name":"/controller/configs/authUser/tls.crt"}
2023-08-02 11:24:39.989035+00:00{"level":"info","ts":"2023-08-02T11:24:39Z","msg":"updated configuration file","name":"/controller/configs/authUser/tls.key"}
2023-08-02 11:24:40.010139+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"updated configuration file","name":"/controller/configs/pgbouncer.ini"}
2023-08-02 11:24:40.022819+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"updated configuration file","name":"/controller/configs/pg_hba.conf"}
2023-08-02 11:24:40.034258+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"updated configuration file","name":"/controller/configs/server-tls/ca.crt"}
2023-08-02 11:24:40.045566+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"updated configuration file","name":"/controller/configs/client-ca/ca.crt"}
2023-08-02 11:24:40.049935+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"record","pipe":"stderr","record":{"timestamp":"2023-08-02 11:24:40.049 UTC","pid":"25","level":"LOG","msg":"kernel file descriptor limit: 1048576 (hard: 1048576); max_client_conn: 1000, max expected fd use: 1012"}}
2023-08-02 11:24:40.050049+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"record","pipe":"stderr","record":{"timestamp":"2023-08-02 11:24:40.049 UTC","pid":"25","level":"LOG","msg":"listening on 0.0.0.0:5432"}}
2023-08-02 11:24:40.050070+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"record","pipe":"stderr","record":{"timestamp":"2023-08-02 11:24:40.049 UTC","pid":"25","level":"LOG","msg":"listening on [::]:5432"}}
2023-08-02 11:24:40.050144+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"record","pipe":"stderr","record":{"timestamp":"2023-08-02 11:24:40.050 UTC","pid":"25","level":"LOG","msg":"listening on unix:/controller/run/.s.PGSQL.5432"}}
2023-08-02 11:24:40.050167+00:00{"level":"info","ts":"2023-08-02T11:24:40Z","msg":"record","pipe":"stderr","record":{"timestamp":"2023-08-02 11:24:40.050 UTC","pid":"25","level":"LOG","msg":"process up: PgBouncer 1.19.1, libevent 2.1.8-stable (epoll), adns: udns 0.4, tls: OpenSSL 1.1.1n  15 Mar 2022"}}
====

bootstrap controller
====
2023-08-02 11:24:38.132494+00:00{"level":"info","ts":"2023-08-02T11:24:38Z","msg":"Installing the manager executable","destination":"/controller/manager","version":"1.20.2","build":{"Version":"1.20.2","Commit":"6f7f10b7","Date":"2023-07-27"}}
2023-08-02 11:24:38.336881+00:00{"level":"info","ts":"2023-08-02T11:24:38Z","msg":"Setting 0750 permissions"}
2023-08-02 11:24:38.336907+00:00{"level":"info","ts":"2023-08-02T11:24:38Z","msg":"Bootstrap completed"}
====

home-assistant-system-cnpg-wait
====
2023-08-02 11:31:10.020239+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:10.044019+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:15.044614+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:15.068428+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:20.069293+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:20.094630+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:25.095282+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:25.120344+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:30.121330+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:30.145388+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:35.146276+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:35.168999+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:40.170074+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:40.193768+00:00home-assistant-cnpg-main-rw:5432 - no response
2023-08-02 11:31:45.194652+00:00Testing database on url:  home-assistant-cnpg-main-rw
2023-08-02 11:31:45.221059+00:00home-assistant-cnpg-main-rw:5432 - no response
[… infinitely this…]

Application Configuration

I don’t think there is anything relevant in my config since it worked like a charm on the previous version.

Describe the bug

When starting, the app is stuck waiting for bgbouncer that has properly started.

To Reproduce

I upgraded from previous version.

Expected Behavior

The app should start.

Screenshots

image

Additional Context

Strangely, rolling back to 19.0.37 does not fix the issue…

I've read and agree with the following

qraynaud commented 1 year ago

I deleted the app and created it again. Seems to have fixed the issue. Dunno if it warrants a close or not. It’s not an ideal way of solving the issue.

PrivatePuffin commented 1 year ago

There is not enough information to reproduce, so i'm closing this issue as we cannot work with you anymore on reproducing and bugtracing...

truecharts-admin commented 1 year ago

This issue is locked to prevent necro-posting on closed issues. Please create a new issue or contact staff on discord of the problem persists