timescale / helm-charts

Configuration and Documentation to run TimescaleDB in your Kubernetes cluster
Apache License 2.0
264 stars 223 forks source link

postgresql core dump crashes timescale database #630

Open mqueack opened 1 year ago

mqueack commented 1 year ago

What happened? Database crashes in azure cloud, because "no space left on device". data & wal device have 1GB size of all tables is smaller than 500KB 1 Standby & Backup is configured This problem is that two core dumps needed all space of PV and database crash.

Did you expect to see something different?

  1. Where can i disable the core dump function in timescale helm
  2. Where is it possible to find more information why coredump is happening (SELECT seems to little information)

How to reproduce it (as minimally and precisely as possible):

Environment

Server Version: version.Info{Major:"1", Minor:"27", GitVersion:"v1.27.3", GitCommit:"31eb725f9812713ec7fd6cf293466ce4fdc7efa8", GitTreeState:"clean", BuildDate:"2023-10-09T14:42:41Z", GoVersion:"go1.20.5", Compiler:"gc", Platform:"linux/amd64"}

azure

Anything else we need to know?:

postgres@k-db-0:/$ gdb ./usr/lib/postgresql/14/bin/postgres /var/lib/postgresql/data/core.638917 GNU gdb (Ubuntu 12.1-0ubuntu1~22.04) 12.1 Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: https://www.gnu.org/software/gdb/bugs/. Find the GDB manual and other documentation resources online at: http://www.gnu.org/software/gdb/documentation/.

For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from ./usr/lib/postgresql/14/bin/postgres... Reading symbols from /usr/lib/debug/.build-id/6b/1469c8b74125c49ed6215dfa6d0b33221b9c7d.debug...

warning: Can't open file /dev/shm/PostgreSQL.446193454 during file-backed mapping note processing

warning: Can't open file /SYSV00002001 (deleted) during file-backed mapping note processing

warning: Can't open file /dev/zero (deleted) during file-backed mapping note processing [New LWP 638917] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `postgres: k-db: postgres postgres [local] SELECT '. Program terminated with signal SIGABRT, Aborted.

0 0x00007feb46a50a7c in pthread_kill () from /lib/x86_64-linux-gnu/libc.so.6

(gdb)