Streams not loading after couple of days of uptime.

allluke commented 1 year ago

Describe the bug

Streams keeps on freezing and I don't know why. Everytime I create a Yunohost Streams instance after a wee while it freezes. Yunohost works just fine, as do other apps installed.

Context

Hardware: VPS bought online OVH 4 Cores AMD, 4GB Ram.
YunoHost version: 11.2.6 (stable)
I have access to my server: Through SSH and through the webadmin.
Are you in a special context or did you perform some particular tweaking on your YunoHost instance?: no

Steps to reproduce

Install Streams via webadmin.
Connect to a few connections and wait a day or two.
Try to load streams and it fails with "Apologies but this site is unavailable at the moment. Please try again later."

Expected behavior

The page to load and all to be well.

Logs

As discussed in a previous discussion via streams

TOP: top - 05:47:21 up 21:57, 1 user, load average: 0.01, 0.03, 0.00 Tasks: 158 total, 1 running, 157 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.1 us, 0.0 sy, 0.0 ni, 99.8 id, 0.1 wa, 0.0 hi, 0.0 si, 0.0 st MiB Mem : 3837.4 total, 1651.1 free, 1391.9 used, 794.4 buff/cache MiB Swap: 0.0 total, 0.0 free, 0.0 used. 2105.9 avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 1554 root 20 0 1577848 19768 0 S 0.7 0.5 5:29.80 fail2ban-server 689 mastodon 20 0 940940 54172 15896 S 0.3 1.4 3:20.08 node 690 mastodon 20 0 467524 229816 2160 S 0.3 5.8 0:12.15 ruby 699 redis 20 0 75888 16472 2704 S 0.3 0.4 3:05.30 redis-server 276093 root 20 0 10200 3684 2936 R 0.3 0.1 0:00.01 top 1 root 20 0 165424 8000 4944 S 0.0 0.2 0:11.80 systemd 2 root 20 0 0 0 0 S 0.0 0.0 0:00.01 kthreadd 3 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 rcu_gp 4 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 rcu_par_gp 6 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/0:0H-events_highpri 8 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 mm_percpu_wq 9 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_tasksrude 10 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_tasks_trace 11 root 20 0 0 0 0 S 0.0 0.0 0:02.02 ksoftirqd/0 12 root 20 0 0 0 0 I 0.0 0.0 0:24.73 rcu_sched 13 root rt 0 0 0 0 S 0.0 0.0 0:00.23 migration/0 15 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/0 16 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/1 17 root rt 0 0 0 0 S 0.0 0.0 0:00.52 migration/1 18 root 20 0 0 0 0 S 0.0 0.0 0:01.25 ksoftirqd/1 20 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/1:0H-events_highpri 21 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/2 22 root rt 0 0 0 0 S 0.0 0.0 0:00.52 migration/2 23 root 20 0 0 0 0 S 0.0 0.0 0:00.64 ksoftirqd/2 25 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/2:0H-events_highpri 26 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/3 27 root rt 0 0 0 0 S 0.0 0.0 0:00.52 migration/3 28 root 20 0 0 0 0 S 0.0 0.0 0:00.62 ksoftirqd/3 30 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/3:0H-events_highpri 34 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kdevtmpfs 35 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 netns 36 root 20 0 0 0 0 S 0.0 0.0 0:00.05 kauditd 37 root 20 0 0 0 0 S 0.0 0.0 0:00.03 khungtaskd 38 root 20 0 0 0 0 S 0.0 0.0 0:00.00 oom_reaper 39 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 writeback 40 root 20 0 0 0 0 S 0.0 0.0 0:01.46 kcompactd0 41 root 25 5 0 0 0 S 0.0 0.0 0:00.00 ksmd 42 root 39 19 0 0 0 S 0.0 0.0 0:01.80 khugepaged 62 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kintegrityd 63 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kblockd 64 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 blkcg_punt_bio 65 root 0 -20 0 0 0 I 0.0 0.0 0:03.59 kworker/0:1H-kblockd 66 root 20 0 0 0 0 S 0.0 0.0 0:18.74 kswapd0 67 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kthrotld 68 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 acpi_thermal_pm 69 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 nvme-wq 70 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 nvme-reset-wq 71 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 nvme-delete-wq 72 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 ipv6_addrconf 78 root 20 0 0 0 0 I 0.0 0.0 0:02.45 kworker/1:1-events 82 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kstrp 87 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/u9:0 110 root 0 -20 0 0 0 I 0.0 0.0 0:03.63 kworker/3:1H-kblockd 139 root 0 -20 0 0 0 I 0.0 0.0 0:03.64 kworker/1:1H-kblockd 140 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 ata_sff 141 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_0 142 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 scsi_tmf_0 143 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_1 144 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 scsi_tmf_1
I just ran sudo systemctl status mysqld and it was stopped. I am only guess since after running start and enable that my borg backup stopped it for backing up and didn't restart.

Thoughts?

allluke commented 1 year ago

Sorry 2. should read

I just ran sudo systemctl status mysqld and it wasn't running. I then ran start and enable and streams began working fine again. I'm guessing that my borgbackup stopped mysql and didn't restart it. Do you think this is the case or something else that would cause it to stop???

dragondaddy commented 1 year ago

I don't use BorgBackup so I really don't know how it works. Is it possible to manually create a backup in command line? If so, there probably is an option to have some kind of verbose mode where you see everything that happens. And then you'd check if mysqld is stopped during the process and could ask those who handle the BorgBackup normal if it's a bug.

YunoHost-Apps / streams_ynh