search

bitnami / charts

Bitnami Helm Charts
https://bitnami.com
Other
8.88k stars 9.16k forks source link

[bitnami/mariadb-galera] Access denied livenessprobe after installation with helm #2668

Closed jc-lab closed 4 years ago

jc-lab commented 4 years ago

Which chart: mariadb-galera-2.1.4

Describe the bug Access denied error on access by livenessprobe right after installation with helm.

To Reproduce

  1. values.yaml (Change password settings only.) 
    image:
registry: docker.io
repository: bitnami/mariadb-galera
tag: 10.4.13-debian-10-r7
pullPolicy: IfNotPresent
debug: false
clusterDomain: cluster.local
service:
type: ClusterIP
port: 3306
annotations: {}
serviceAccount:
create: false
extraEnvVars:
extraEnvVarsCM:
extraEnvVarsSecret:
rbac:
create: false
securityContext:
enabled: true
fsGroup: 1001
runAsUser: 1001
rootUser:
password: 1234
forcePassword: true
db:
user: testuser
password: test1234
name: test_db
forcePassword: true
galera:
name: galera
mariabackup:
user: mariabackup
password: 1234
forcePassword: true
ldap:
enabled: false
uri:
base:
binddn:
bindpw:
bslookup:
nss_initgroups_ignoreusers: root,nslcd
scope:
tls_reqcert:
tls:
enabled: false
mariadbConfiguration: |-
[client]
port=3306
socket=/opt/bitnami/mariadb/tmp/mysql.sock
plugin_dir=/opt/bitnami/mariadb/plugin
[mysqld]
default-storage-engine=InnoDB
basedir=/opt/bitnami/mariadb
datadir=/bitnami/mariadb/data
plugin_dir=/opt/bitnami/mariadb/plugin
tmpdir=/opt/bitnami/mariadb/tmp
socket=/opt/bitnami/mariadb/tmp/mysql.sock
pid-file=/opt/bitnami/mariadb/tmp/mysqld.pid
bind-address=0.0.0.0
collation-server=utf8_unicode_ci
init-connect='SET NAMES utf8'
character-set-server=utf8
key-buffer-size=32M
myisam-recover-options=FORCE,BACKUP
skip-host-cache
skip-name-resolve
max-allowed-packet=16M
max-connect-errors=1000000
sql-mode=STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_AUTO_VALUE_ON_ZERO,NO_ENGINE_SUBSTITUTION,NO_ZERO_DATE,NO_ZERO_IN_DATE,ONLY_FULL_GROUP_BY
sysdate-is-now=1
innodb=FORCE
innodb-strict-mode=1
innodb_file_per_table=1
innodb-autoinc-lock-mode=2
innodb-doublewrite=1
innodb_flush_log_at_trx_commit=0
log-bin=mysql-bin
expire-logs-days=14
sync-binlog=0
binlog-format=row
tmp-table-size=32M
max-heap-table-size=32M
query-cache-type=1
query-cache-limit=4M
query-cache-size=256M
max-connections=500
thread-cache-size=50
open-files-limit=65535
table-definition-cache=4096
table-open-cache=4096
innodb-flush-method=O_DIRECT
innodb-log-files-in-group=2
innodb-log-file-size=128M
innodb-flush-log-at-trx-commit=1
innodb-file-per-table=1
innodb-buffer-pool-size=1G
innodb_file_format=Barracuda
log-error=/opt/bitnami/mariadb/logs/mysqld.log
slow-query-log-file=/opt/bitnami/mariadb/logs/mysqld.log
log-queries-not-using-indexes=1
slow-query-log=1
[galera]
wsrep_on=ON
wsrep_provider=/opt/bitnami/mariadb/lib/libgalera_smm.so
wsrep_sst_method=mariabackup
wsrep_slave_threads=4
wsrep_cluster_address=gcomm://
wsrep_cluster_name=galera
wsrep_sst_auth="root:"
innodb-flush-log-at-trx-commit=2
wsrep_replicate_myisam=ON
[mariadb]
plugin_load_add=auth_pam
replicaCount: 3
updateStrategy:
type: RollingUpdate
podAnnotations: {}
affinity: {}
nodeSelector: {}
tolerations: {}
persistence:
enabled: true
mountPath: /bitnami/mariadb
storageClass: my-storage-class
annotations:
accessModes:
- ReadWriteOnce
size: 64Gi
extraInitContainers: []
extraContainers: []
livenessProbe:
enabled: true
initialDelaySeconds: 120
periodSeconds: 10
timeoutSeconds: 1
successThreshold: 1
failureThreshold: 3
readinessProbe:
enabled: true
initialDelaySeconds: 30
periodSeconds: 10
timeoutSeconds: 1
successThreshold: 1
failureThreshold: 3
podDisruptionBudget:
create: false
minAvailable: 1
metrics:
enabled: true
image:
registry: docker.io
repository: bitnami/mysqld-exporter
tag: 0.12.1-debian-10-r114
pullPolicy: IfNotPresent
resources:
limits: {}
requests: {}
service:
type: ClusterIP
port: 9104
annotations:
  prometheus.io/scrape: "true"
  prometheus.io/port: "9104"
serviceMonitor:
enabled: false
selector:
  prometheus: kube-prometheus
  2. helm install --namespace test --name test-db-1 bitnami/mariadb-galera --values values.yaml

Expected behavior A clear and concise description of what you expected to happen.

Version of Helm and Kubernetes:

Client Version: version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.8", GitCommit:"ec6eb119b81be488b030e849b9e64fda4caaf33c", GitTreeState:"clean", BuildDate:"2020-03-12T21:00:06Z", GoVersion:"go1.13.8", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.8", GitCommit:"ec6eb119b81be488b030e849b9e64fda4caaf33c", GitTreeState:"clean", BuildDate:"2020-03-12T20:52:22Z", GoVersion:"go1.13.8", Compiler:"gc", Platform:"linux/amd64"}

Log:

 12:13:31.10
 12:13:31.10 Welcome to the Bitnami mariadb-galera container
 12:13:31.11 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-mariadb-galera
 12:13:31.11 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-mariadb-galera/issues
 12:13:31.11
 12:13:31.12 INFO  ==> ** Starting MariaDB setup **
 12:13:31.26 INFO  ==> Validating settings in MYSQL_*/MARIADB_* env vars..
 12:13:31.28 INFO  ==> Initializing mariadb database...
 12:13:31.30 INFO  ==> Persisted data detected. Restoring...

 12:13:31.31 INFO  ==> ** MariaDB setup finished! **
 12:13:31.45 INFO  ==> ** Starting MariaDB **
2020-05-26 12:13:31 0 [Note] /opt/bitnami/mariadb/sbin/mysqld (mysqld 10.4.13-MariaDB-log) starting as process 1 ...
2020-05-26 12:13:31 0 [Note] WSREP: Loading provider /opt/bitnami/mariadb/lib/libgalera_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1
wsrep loader: [INFO] wsrep_load(): loading provider library '/opt/bitnami/mariadb/lib/libgalera_smm.so'
wsrep loader: [INFO] wsrep_load(): Galera 4.5(r0) by Codership Oy <info@codership.com> loaded successfully.
2020-05-26 12:13:31 0 [Note] WSREP: CRC-32C: using hardware acceleration.
2020-05-26 12:13:31 0 [Note] WSREP: Found saved state: 46fd15e9-9f4a-11ea-b1fb-93e77201446b:1, safe_to_bootstrap: 1
2020-05-26 12:13:31 0 [Note] WSREP: GCache DEBUG: opened preamble:
Version: 2
UUID: 46fd15e9-9f4a-11ea-b1fb-93e77201446b
Seqno: 1 - 1
Offset: 1280
Synced: 1
2020-05-26 12:13:31 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 46fd15e9-9f4a-11ea-b1fb-93e77201446b, offset: 1280
2020-05-26 12:13:31 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (        0/134217752 bytes) complete.
2020-05-26 12:13:31 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete.
2020-05-26 12:13:31 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 1-1
2020-05-26 12:13:31 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (  0/192 bytes) complete.
2020-05-26 12:13:31 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (192/192 bytes) complete.
2020-05-26 12:13:31 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/1 locked buffers
2020-05-26 12:13:31 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 134217536/134217728
2020-05-26 12:13:31 0 [Note] WSREP: Passing config to GCS: base_dir = /bitnami/mariadb/data/; base_host = 172.30.2.46; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /bitnami/mariadb/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S...
2020-05-26 12:13:31 0 [Note] WSREP: Service thread queue flushed.
2020-05-26 12:13:31 0 [Note] WSREP: ####### Assign initial position for certification: 46fd15e9-9f4a-11ea-b1fb-93e77201446b:1, protocol version: -1
2020-05-26 12:13:31 0 [Note] WSREP: Start replication
2020-05-26 12:13:31 0 [Note] WSREP: Connecting with bootstrap option: 1
2020-05-26 12:13:31 0 [Note] WSREP: Setting GCS initial position to 46fd15e9-9f4a-11ea-b1fb-93e77201446b:1
2020-05-26 12:13:31 0 [Note] WSREP: protonet asio version 0
2020-05-26 12:13:31 0 [Note] WSREP: Using CRC-32C for message checksums.
2020-05-26 12:13:31 0 [Note] WSREP: backend: asio
2020-05-26 12:13:31 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2020-05-26 12:13:31 0 [Warning] WSREP: access file(/bitnami/mariadb/data//gvwstate.dat) failed(No such file or directory)
2020-05-26 12:13:31 0 [Note] WSREP: restore pc from disk failed
2020-05-26 12:13:31 0 [Note] WSREP: GMCast version 0
2020-05-26 12:13:31 0 [Note] WSREP: (509ae829-b5e7, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2020-05-26 12:13:31 0 [Note] WSREP: (509ae829-b5e7, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2020-05-26 12:13:31 0 [Note] WSREP: EVS version 1
2020-05-26 12:13:31 0 [Note] WSREP: gcomm: bootstrapping new group 'galera'
2020-05-26 12:13:31 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery
2020-05-26 12:13:31 0 [Note] WSREP: EVS version upgrade 0 -> 1
2020-05-26 12:13:31 0 [Note] WSREP: PC protocol upgrade 0 -> 1
2020-05-26 12:13:31 0 [Note] WSREP: Node 509ae829-b5e7 state prim
2020-05-26 12:13:31 0 [Note] WSREP: view(view_id(PRIM,509ae829-b5e7,1) memb {
        509ae829-b5e7,0
} joined {
} left {
} partitioned {
})
2020-05-26 12:13:31 0 [Note] WSREP: save pc into disk
2020-05-26 12:13:31 0 [Note] WSREP: gcomm: connected
2020-05-26 12:13:31 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2020-05-26 12:13:31 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2020-05-26 12:13:31 0 [Note] WSREP: Opened channel 'galera'
2020-05-26 12:13:31 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
2020-05-26 12:13:31 2 [Note] WSREP: Starting rollbacker thread 2
2020-05-26 12:13:31 1 [Note] WSREP: Starting applier thread 1
2020-05-26 12:13:31 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 50a431b8-9f4a-11ea-b4f2-67272d4853cc
2020-05-26 12:13:31 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 50a431b8-9f4a-11ea-b4f2-67272d4853cc
2020-05-26 12:13:31 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50a431b8-9f4a-11ea-b4f2-67272d4853cc from 0 (zeronsoftn-test1-zeroback-db-mariadb-galera-0)
2020-05-26 12:13:31 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 0,
        members    = 1/1 (joined/total),
        act_id     = 1,
        last_appl. = 1,
        protocols  = 2/10/4 (gcs/repl/appl),
        vote policy= 0,
        group UUID = 46fd15e9-9f4a-11ea-b1fb-93e77201446b
2020-05-26 12:13:31 0 [Note] WSREP: Flow-control interval: [16, 16]
2020-05-26 12:13:31 0 [Note] WSREP: Restored state OPEN -> JOINED (2)
2020-05-26 12:13:31 0 [Note] WSREP: Member 0.0 (zeronsoftn-test1-zeroback-db-mariadb-galera-0) synced with group.
2020-05-26 12:13:31 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
2020-05-26 12:13:31 1 [Note] WSREP: ####### processing CC 2, local, ordered
2020-05-26 12:13:31 1 [Note] WSREP: Process first view: 46fd15e9-9f4a-11ea-b1fb-93e77201446b my uuid: 509ae829-9f4a-11ea-b5e7-d64e51777cc2
2020-05-26 12:13:31 1 [Note] WSREP: Server zeronsoftn-test1-zeroback-db-mariadb-galera-0 connected to cluster at position 46fd15e9-9f4a-11ea-b1fb-93e77201446b:2 with ID 509ae829-9f4a-11ea-b5e7-d64e51777cc2
2020-05-26 12:13:31 1 [Note] WSREP: Server status change disconnected -> connected
2020-05-26 12:13:31 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:31 1 [Note] WSREP: ####### My UUID: 509ae829-9f4a-11ea-b5e7-d64e51777cc2
2020-05-26 12:13:31 1 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: no
2020-05-26 12:13:31 0 [Note] WSREP: Service thread queue flushed.
2020-05-26 12:13:31 1 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2020-05-26 12:13:31 1 [Note] WSREP: REPL Protocols: 10 (5)
2020-05-26 12:13:31 1 [Note] WSREP: ####### Adjusting cert position: -1 -> 2
2020-05-26 12:13:31 0 [Note] WSREP: Service thread queue flushed.
2020-05-26 12:13:32 1 [Note] WSREP: ================================================
View:
  id: 46fd15e9-9f4a-11ea-b1fb-93e77201446b:2
  status: primary
  protocol_version: 4
  capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
  final: no
  own_index: 0
  members(1):
        0: 509ae829-9f4a-11ea-b5e7-d64e51777cc2, zeronsoftn-test1-zeroback-db-ma
=================================================
2020-05-26 12:13:32 1 [Note] WSREP: Server status change connected -> joiner
2020-05-26 12:13:32 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:32 1 [Note] WSREP: Server status change joiner -> initializing
2020-05-26 12:13:32 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:32 0 [Warning] The parameter innodb_file_format is deprecated and has no effect. It may be removed in future releases. See https://mariadb.com/kb/en/library/xtradbinnodb-file-format/
2020-05-26 12:13:32 0 [Note] InnoDB: Using Linux native AIO
2020-05-26 12:13:32 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2020-05-26 12:13:32 0 [Note] InnoDB: Uses event mutexes
2020-05-26 12:13:32 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2020-05-26 12:13:32 0 [Note] InnoDB: Number of pools: 1
2020-05-26 12:13:32 0 [Note] InnoDB: Using SSE2 crc32 instructions
2020-05-26 12:13:32 0 [Note] mysqld: O_TMPFILE is not supported on /opt/bitnami/mariadb/tmp (disabling future attempts)
2020-05-26 12:13:32 0 [Note] InnoDB: Initializing buffer pool, total size = 1G, instances = 8, chunk size = 128M
2020-05-26 12:13:32 0 [Note] InnoDB: Completed initialization of buffer pool
2020-05-26 12:13:32 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2020-05-26 12:13:32 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2020-05-26 12:13:32 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2020-05-26 12:13:32 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2020-05-26 12:13:32 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2020-05-26 12:13:32 0 [Note] InnoDB: 10.4.13 started; log sequence number 74946; transaction id 46
2020-05-26 12:13:32 0 [Note] InnoDB: Loading buffer pool(s) from /bitnami/mariadb/data/ib_buffer_pool
2020-05-26 12:13:32 0 [Note] Plugin 'FEEDBACK' is disabled.
/opt/bitnami/mariadb/sbin/mysqld, Version: 10.4.13-MariaDB-log (Source distribution). started with:
Tcp port: 3306  Unix socket: /opt/bitnami/mariadb/tmp/mysql.sock
Time                Id Command  Argument
2020-05-26 12:13:32 0 [Note] InnoDB: Buffer pool(s) load completed at 200526 12:13:32
2020-05-26 12:13:33 0 [Note] Server socket created on IP: '0.0.0.0'.
2020-05-26 12:13:33 0 [Warning] 'user' entry 'root@zeronsoftn-test1-zeroback-db-mariadb-galera-0' ignored in --skip-name-resolve mode.
2020-05-26 12:13:33 0 [Warning] 'user' entry '@zeronsoftn-test1-zeroback-db-mariadb-galera-0' ignored in --skip-name-resolve mode.
2020-05-26 12:13:33 0 [Warning] 'proxies_priv' entry '@% root@zeronsoftn-test1-zeroback-db-mariadb-galera-0' ignored in --skip-name-resolve mode.
2020-05-26 12:13:33 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
2020-05-26 12:13:33 0 [Note] WSREP: Server initialized
2020-05-26 12:13:33 0 [Note] WSREP: Server status change initializing -> initialized
2020-05-26 12:13:33 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:33 1 [Note] WSREP: Bootstrapping a new cluster, setting initial position to 00000000-0000-0000-0000-000000000000:-1
2020-05-26 12:13:33 13 [Note] WSREP: Starting applier thread 13
2020-05-26 12:13:33 12 [Note] WSREP: Starting applier thread 12
2020-05-26 12:13:33 11 [Note] WSREP: Starting applier thread 11
2020-05-26 12:13:33 0 [Note] Reading of all Master_info entries succeeded
2020-05-26 12:13:33 0 [Note] Added new Master_info '' to hash table
2020-05-26 12:13:33 0 [Note] /opt/bitnami/mariadb/sbin/mysqld: ready for connections.
Version: '10.4.13-MariaDB-log'  socket: '/opt/bitnami/mariadb/tmp/mysql.sock'  port: 3306  Source distribution
2020-05-26 12:13:33 10 [Note] WSREP: Recovered cluster id 46fd15e9-9f4a-11ea-b1fb-93e77201446b
2020-05-26 12:13:33 1 [Note] WSREP: Server status change initialized -> joined
2020-05-26 12:13:33 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:33 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:33 1 [Note] WSREP: Lowest cert index boundary for CC from group: 2
2020-05-26 12:13:33 1 [Note] WSREP: Min available from gcache for CC from group: 1
2020-05-26 12:13:33 1 [Note] WSREP: Server zeronsoftn-test1-zeroback-db-mariadb-galera-0 synced with group
2020-05-26 12:13:33 1 [Note] WSREP: Server status change joined -> synced
2020-05-26 12:13:33 1 [Note] WSREP: Synchronized with group, ready for connections
2020-05-26 12:13:33 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2020-05-26 12:13:41 16 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:13:42 17 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:13:51 18 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:13:52 19 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:01 20 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:02 21 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
2020-05-26 12:14:02 22 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:08 23 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:11 24 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:12 25 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
2020-05-26 12:14:12 26 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:21 27 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:22 28 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
2020-05-26 12:14:22 29 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:31 30 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:32 31 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
2020-05-26 12:14:32 32 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:41 33 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:42 34 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
2020-05-26 12:14:42 35 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:51 36 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)
2020-05-26 12:14:52 37 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
2020-05-26 12:14:52 38 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: YES)

Other Issues

1788

Maybe same issue. PVC is new, so it has nothing to do with upgrade.

2013

If set MARIADB_INIT_SLEEP_TIME to 30 seconds, the following error occurs.

 12:44:11.71
 12:44:11.71 Welcome to the Bitnami mariadb-galera container
 12:44:11.71 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-mariadb-galera
 12:44:11.72 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-mariadb-galera/issues
 12:44:11.72
 12:44:11.72 INFO  ==> ** Starting MariaDB setup **
 12:44:11.85 INFO  ==> Validating settings in MYSQL_*/MARIADB_* env vars..
 12:44:11.86 INFO  ==> Initializing mariadb database...
 12:44:42.21 INFO  ==> Starting mariadb in background
 12:45:32.85 INFO  ==> Stopping mariadb
 12:45:37.86 INFO  ==> ** MariaDB setup finished! **

 12:45:37.99 INFO  ==> ** Starting MariaDB **
2020-05-26 12:45:38 0 [Note] /opt/bitnami/mariadb/sbin/mysqld (mysqld 10.4.13-MariaDB-log) starting as process 1 ...
2020-05-26 12:45:38 0 [Note] WSREP: Loading provider /opt/bitnami/mariadb/lib/libgalera_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1
wsrep loader: [INFO] wsrep_load(): loading provider library '/opt/bitnami/mariadb/lib/libgalera_smm.so'
wsrep loader: [INFO] wsrep_load(): Galera 4.5(r0) by Codership Oy <info@codership.com> loaded successfully.
2020-05-26 12:45:38 0 [Note] WSREP: CRC-32C: using hardware acceleration.
2020-05-26 12:45:38 0 [Note] WSREP: Found saved state: abfa9514-9f4e-11ea-a62b-babb3792dac8:14, safe_to_bootstrap: 1
2020-05-26 12:45:38 0 [Note] WSREP: GCache DEBUG: opened preamble:
Version: 2
UUID: abfa9514-9f4e-11ea-a62b-babb3792dac8
Seqno: 1 - 14
Offset: 1280
Synced: 1
2020-05-26 12:45:38 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: abfa9514-9f4e-11ea-a62b-babb3792dac8, offset: 1280
2020-05-26 12:45:38 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (        0/134217752 bytes) complete.
2020-05-26 12:45:38 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete.
2020-05-26 12:45:38 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 1-14
2020-05-26 12:45:38 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (   0/6944 bytes) complete.
2020-05-26 12:45:38 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (6944/6944 bytes) complete.
2020-05-26 12:45:38 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/14 locked buffers
2020-05-26 12:45:38 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 134210784/134217728
2020-05-26 12:45:38 0 [Note] WSREP: Passing config to GCS: base_dir = /bitnami/mariadb/data/; base_host = 172.30.2.51; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /bitnami/mariadb/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S...
2020-05-26 12:45:38 0 [Note] WSREP: Service thread queue flushed.
2020-05-26 12:45:38 0 [Note] WSREP: ####### Assign initial position for certification: abfa9514-9f4e-11ea-a62b-babb3792dac8:14, protocol version: -1
2020-05-26 12:45:38 0 [Note] WSREP: Start replication
2020-05-26 12:45:38 0 [Note] WSREP: Connecting with bootstrap option: 0
2020-05-26 12:45:38 0 [Note] WSREP: Setting GCS initial position to abfa9514-9f4e-11ea-a62b-babb3792dac8:14
2020-05-26 12:45:38 0 [Note] WSREP: protonet asio version 0
2020-05-26 12:45:38 0 [Note] WSREP: Using CRC-32C for message checksums.
2020-05-26 12:45:38 0 [Note] WSREP: backend: asio
2020-05-26 12:45:38 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2020-05-26 12:45:38 0 [Warning] WSREP: access file(/bitnami/mariadb/data//gvwstate.dat) failed(No such file or directory)
2020-05-26 12:45:38 0 [Note] WSREP: restore pc from disk failed
2020-05-26 12:45:38 0 [Note] WSREP: GMCast version 0
2020-05-26 12:45:38 0 [Note] WSREP: (cce64dd5-a248, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2020-05-26 12:45:38 0 [Note] WSREP: (cce64dd5-a248, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2020-05-26 12:45:38 0 [Note] WSREP: EVS version 1
2020-05-26 12:45:38 0 [Note] WSREP: gcomm: connecting to group 'galera', peer '...svc.cluster.local:'
2020-05-26 12:45:38 0 [Note] WSREP: (cce64dd5-a248, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://172.30.2.51:4567
2020-05-26 12:45:41 0 [Note] WSREP: EVS version upgrade 0 -> 1
2020-05-26 12:45:41 0 [Note] WSREP: PC protocol upgrade 0 -> 1
2020-05-26 12:45:41 0 [Warning] WSREP: no nodes coming from prim view, prim not possible
2020-05-26 12:45:41 0 [Note] WSREP: view(view_id(NON_PRIM,cce64dd5-a248,1) memb {
        cce64dd5-a248,0
} joined {
} left {
} partitioned {
})
2020-05-26 12:45:41 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50114S), skipping check
2020-05-26 12:45:48 0 [Note] WSREP: (cce64dd5-a248, 'tcp://0.0.0.0:4567') connection established to d2c16b9c-af8d tcp://172.30.1.8:4567
2020-05-26 12:45:48 0 [Note] WSREP: (cce64dd5-a248, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2020-05-26 12:45:48 0 [Note] WSREP: declaring d2c16b9c-af8d at tcp://172.30.1.8:4567 stable
2020-05-26 12:45:48 0 [Warning] WSREP: no nodes coming from prim view, prim not possible
2020-05-26 12:45:48 0 [Note] WSREP: view(view_id(NON_PRIM,cce64dd5-a248,2) memb {
        cce64dd5-a248,0
        d2c16b9c-af8d,0
} joined {
} left {
} partitioned {
})
2020-05-26 12:45:51 0 [Note] WSREP: (cce64dd5-a248, 'tcp://0.0.0.0:4567') turning message relay requesting off
2020-05-26 12:46:11 0 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)
         at gcomm/src/pc.cpp:connect():160
2020-05-26 12:46:11 0 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():220: Failed to open backend connection: -110 (Connection timed out)
2020-05-26 12:46:11 0 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1632: Failed to open channel 'galera' at 'gcomm://....cluster.local': -110 (Connection timed out)
2020-05-26 12:46:11 0 [ERROR] WSREP: gcs connect failed: Connection timed out
2020-05-26 12:46:11 0 [ERROR] WSREP: wsrep::connect(gcomm://....cluster.local) failed: 7
2020-05-26 12:46:11 0 [ERROR] Aborting
Warning: Memory not freed: 48
miguelaeh commented 4 years ago

Hi @jc-lab , I recommend you to quote the passwords in the values.yaml file, if not, as you are using a number it will be interpreted as an Integer instead of a String and it could fail rendering the secret template.

Regarding the issue, I copied your values, deleted the storage class, and used the same passwords but converting them into strings and the chart is running as expected for me. Be sure to delete the PVCs once you uninstall the release because they are not deleted automatically and they can contain an old password, then try to install it again. You commented the PVCs are new, but could you confirm you deleted all the resources related to the previous release and then re-deploy?

Regarding the second error, it seems to be a timeout so probably 30 seconds is too much in your case. Could you share wich k8s cluster are you using?

jc-lab commented 4 years ago

@miguelaeh Passwords are not really numbers, they are different letters. It's just written randomly to hide.

I am using rook-ceph.

Can a long timeout time be a problem? rather than a short one? Is there any way to succeed while keeping 30 seconds timeout time?

Can you description why does PVC causes can problems? This is just curious. As far as I know, pod won't run until PVC is initialized (formatted).

miguelaeh commented 4 years ago

Hi @jc-lab , When you deploy the Chart the first time, the container is configured and it persists its configuration into the PV (the PVC provides that PV). When you redeploy the chart, or install a new one without deleting the PVCs, the container will detect data mounted inside the PVC and it will skip the configuration process, so it will be configured with the persisted data. In this case, the password will remain the same as in the previous deployment even if you specify a different password, because the application will not be configured with the new password, but with the persisted one.

Regarding the timeout, I wanted to say that it is not enough, sorry for the confusion. You can see here the explanation about it https://github.com/bitnami/bitnami-docker-mariadb-galera/#slow-filesystems.

jc-lab commented 4 years ago

@miguelaeh Thanks for reply.

In my case, it same both.

  1. when both pvc and pv were absent.
  2. When deleting pv and pvc and retrying.

But after changing the timeout time and trying a few times, it worked!

You were helpful. Thank you.

nishit93-hub commented 3 years ago

@jc-lab,

I am facing same issue with mariadb-galera.

Two of my nodes got down, i have made them up.However facing issue with mariadb-galera

[Note] WSREP: gcomm: connecting to group 'galera', peer 'mariadb-galera-headless:'

2020-12-22 8:19:39 0 [ERROR] WSREP: failed to open gcomm backend connection: 131: No address to connect (FATAL)

 at gcomm/src/gmcast.cpp:connect_precheck():311

2020-12-22 8:19:39 0 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():220: Failed to open backend connection: -131 (State not recoverable)

2020-12-22 8:19:39 0 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1632: Failed to open channel 'galera' at 'gcomm://mariadb-galera-headless': -131 (State not recoverable)

2020-12-22 8:19:39 0 [ERROR] WSREP: gcs connect failed: State not recoverable

2020-12-22 8:19:39 0 [ERROR] WSREP: wsrep::connect(gcomm://mariadb-galera-headless) failed: 7

2020-12-22 8:19:39 0 [ERROR] Aborting

Warning: Memory not freed: 48

How did you resolved that, what steps did you follow?