search

dyc3 / opentogethertube

Watch videos with your friends. The spiritual successor to TogetherTube, preserving the spirit of it's simple to use interface, while improving it's look, feel, and reliability.
https://opentogethertube.com
GNU Affero General Public License v3.0
416 stars 57 forks source link

Docker image not migrating database #344

Closed noxhirsch closed 3 years ago

noxhirsch commented 3 years ago

Hi, I'm trying to install OpenTogetherTube locally on my server with Docker. Sadly I couldn't get it running correctly:

Everything seems to start correctly and I also can open the UI and browse through the pages (also open a room via a URL). But I can't create a temporary/permanent room, can't search for videos/add videos (Youtube) and can't chat. Whenever I do anything like this, a loading circle appears and stays forever.

I can see that Redis is putting some stuff in a file "dump.rdb", but when I check Postgres with Adminer there doesn't seem to be anything in the database.

On the server I created the containers manually with Portainer, so I thought this might be the source of the problem. Because of that I followed the "Use Image" section from here to try again on my Win 10 machine with Docker for Windows. But there I had exactly the same problem as before.

I already tried lots of things for hours without any solution... also I can't find anything useful in the logs (in my eyes).

Maybe someone else already had that problem or there's an obvious solution I missed?

If there's important data missing, please tell me and I'll add that to the issue.

Full Log from Docker for Windows Attaching to opentogethertube, opentogethertube_redis, opentogethertube_postgres opentogethertube_postgres | The files belonging to this database system will be owned by user "postgres". opentogethertube_postgres | This user must also own the server process. opentogethertube_postgres | opentogethertube_postgres | The database cluster will be initialized with locale "en_US.utf8". opentogethertube_postgres | The default database encoding has accordingly been set to "UTF8". opentogethertube_postgres | The default text search configuration will be set to "english". opentogethertube_postgres | opentogethertube_postgres | Data page checksums are disabled. opentogethertube_postgres | opentogethertube_postgres | fixing permissions on existing directory /tmp ... ok opentogethertube_postgres | creating subdirectories ... ok opentogethertube_postgres | selecting dynamic shared memory implementation ... posix opentogethertube_postgres | selecting default max_connections ... 100 opentogethertube_postgres | selecting default shared_buffers ... 128MB opentogethertube_postgres | selecting default time zone ... Etc/UTC opentogethertube_postgres | creating configuration files ... ok opentogethertube_postgres | running bootstrap script ... ok opentogethertube_postgres | performing post-bootstrap initialization ... ok opentogethertube_postgres | initdb: warning: enabling "trust" authentication for local connections opentogethertube_postgres | You can change this by editing pg_hba.conf or using the option -A, or opentogethertube_postgres | --auth-local and --auth-host, the next time you run initdb. opentogethertube_postgres | syncing data to disk ... ok opentogethertube_postgres | opentogethertube_postgres | opentogethertube_postgres | Success. You can now start the database server using: opentogethertube_postgres | opentogethertube_postgres | pg_ctl -D /tmp -l logfile start opentogethertube_postgres | opentogethertube_postgres | waiting for server to start....2020-12-20 17:47:22.912 UTC [48] LOG: starting PostgreSQL 13.1 (Debian 13.1-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit opentogethertube_postgres | 2020-12-20 17:47:22.915 UTC [48] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" opentogethertube_postgres | 2020-12-20 17:47:22.926 UTC [49] LOG: database system was shut down at 2020-12-20 17:47:20 UTC opentogethertube_postgres | 2020-12-20 17:47:22.931 UTC [48] LOG: database system is ready to accept connections opentogethertube_postgres | done opentogethertube_postgres | server started opentogethertube_postgres | CREATE DATABASE opentogethertube_postgres | opentogethertube_postgres | opentogethertube_postgres | /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/* opentogethertube_postgres | opentogethertube_postgres | 2020-12-20 17:47:23.883 UTC [48] LOG: received fast shutdown request opentogethertube_postgres | waiting for server to shut down....2020-12-20 17:47:23.886 UTC [48] LOG: aborting any active transactions opentogethertube_postgres | 2020-12-20 17:47:23.887 UTC [48] LOG: background worker "logical replication launcher" (PID 55) exited with exit code 1 opentogethertube_postgres | 2020-12-20 17:47:23.887 UTC [50] LOG: shutting down opentogethertube_postgres | 2020-12-20 17:47:23.908 UTC [48] LOG: database system is shut down opentogethertube_postgres | done opentogethertube_postgres | server stopped opentogethertube_postgres | opentogethertube_postgres | PostgreSQL init process complete; ready for start up. opentogethertube_postgres | opentogethertube_postgres | 2020-12-20 17:47:24.000 UTC [1] LOG: starting PostgreSQL 13.1 (Debian 13.1-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit opentogethertube_postgres | 2020-12-20 17:47:24.000 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 opentogethertube_postgres | 2020-12-20 17:47:24.000 UTC [1] LOG: listening on IPv6 address "::", port 5432 opentogethertube_postgres | 2020-12-20 17:47:24.007 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" opentogethertube_postgres | 2020-12-20 17:47:24.015 UTC [66] LOG: database system was shut down at 2020-12-20 17:47:23 UTC opentogethertube_postgres | 2020-12-20 17:47:24.020 UTC [1] LOG: database system is ready to accept connections opentogethertube_postgres | 2020-12-20 20:47:04.409 UTC [1] LOG: received fast shutdown request opentogethertube_postgres | 2020-12-20 20:47:04.413 UTC [1] LOG: aborting any active transactions opentogethertube_postgres | 2020-12-20 20:47:04.414 UTC [1] LOG: background worker "logical replication launcher" (PID 72) exited with exit code 1 opentogethertube_postgres | 2020-12-20 20:47:04.414 UTC [67] LOG: shutting down opentogethertube_postgres | 2020-12-20 20:47:04.433 UTC [1] LOG: database system is shut down opentogethertube_postgres | opentogethertube_postgres | PostgreSQL Database directory appears to contain a database; Skipping initialization opentogethertube_postgres | opentogethertube_postgres | 2020-12-20 21:06:05.154 UTC [1] LOG: starting PostgreSQL 13.1 (Debian 13.1-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit opentogethertube_postgres | 2020-12-20 21:06:05.154 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 opentogethertube_postgres | 2020-12-20 21:06:05.154 UTC [1] LOG: listening on IPv6 address "::", port 5432 opentogethertube_postgres | 2020-12-20 21:06:05.163 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" opentogethertube_postgres | 2020-12-20 21:06:05.173 UTC [26] LOG: database system was shut down at 2020-12-20 20:47:04 UTC opentogethertube_postgres | 2020-12-20 21:06:05.179 UTC [1] LOG: database system is ready to accept connections opentogethertube_postgres | 2020-12-20 21:10:31.941 UTC [1] LOG: received fast shutdown request opentogethertube_postgres | 2020-12-20 21:10:31.949 UTC [1] LOG: aborting any active transactions opentogethertube_postgres | 2020-12-20 21:10:31.950 UTC [1] LOG: background worker "logical replication launcher" (PID 32) exited with exit code 1 opentogethertube_postgres | 2020-12-20 21:10:31.950 UTC [27] LOG: shutting down opentogethertube_postgres | 2020-12-20 21:10:31.975 UTC [1] LOG: database system is shut down opentogethertube_postgres | opentogethertube_postgres | PostgreSQL Database directory appears to contain a database; Skipping initialization opentogethertube_postgres | opentogethertube_postgres | 2020-12-20 21:10:37.852 UTC [1] LOG: starting PostgreSQL 13.1 (Debian 13.1-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit opentogethertube_postgres | 2020-12-20 21:10:37.878 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 opentogethertube_postgres | 2020-12-20 21:10:37.878 UTC [1] LOG: listening on IPv6 address "::", port 5432 opentogethertube_postgres | 2020-12-20 21:10:37.886 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" opentogethertube_postgres | 2020-12-20 21:10:37.894 UTC [26] LOG: database system was shut down at 2020-12-20 21:10:31 UTC opentogethertube_postgres | 2020-12-20 21:10:37.900 UTC [1] LOG: database system is ready to accept connections opentogethertube_redis | 1:C 20 Dec 2020 17:47:20.120 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo opentogethertube_redis | 1:C 20 Dec 2020 17:47:20.120 # Redis version=6.0.9, bits=64, commit=00000000, modified=0, pid=1, just started opentogethertube_redis | 1:C 20 Dec 2020 17:47:20.120 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf opentogethertube_redis | 1:M 20 Dec 2020 17:47:20.121 * Running mode=standalone, port=6379. opentogethertube_redis | 1:M 20 Dec 2020 17:47:20.121 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. opentogethertube_redis | 1:M 20 Dec 2020 17:47:20.121 # Server initialized opentogethertube_redis | 1:M 20 Dec 2020 17:47:20.121 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. opentogethertube_redis | 1:M 20 Dec 2020 17:47:20.121 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled (set to 'madvise' or 'never'). opentogethertube_redis | 1:M 20 Dec 2020 17:47:20.121 * Ready to accept connections opentogethertube_redis | 1:M 20 Dec 2020 17:52:21.025 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 17:52:21.026 * Background saving started by pid 89 opentogethertube_redis | 89:C 20 Dec 2020 17:52:21.031 * DB saved on disk opentogethertube_redis | 89:C 20 Dec 2020 17:52:21.031 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 17:52:21.126 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 17:57:22.028 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 17:57:22.028 * Background saving started by pid 160 opentogethertube_redis | 160:C 20 Dec 2020 17:57:22.041 * DB saved on disk opentogethertube_redis | 160:C 20 Dec 2020 17:57:22.042 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 17:57:22.129 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:02:23.031 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:02:23.032 * Background saving started by pid 232 opentogethertube_redis | 232:C 20 Dec 2020 18:02:23.037 * DB saved on disk opentogethertube_redis | 232:C 20 Dec 2020 18:02:23.038 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:02:23.132 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:07:24.033 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:07:24.033 * Background saving started by pid 305 opentogethertube_redis | 305:C 20 Dec 2020 18:07:24.039 * DB saved on disk opentogethertube_redis | 305:C 20 Dec 2020 18:07:24.040 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:07:24.134 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:12:25.030 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:12:25.030 * Background saving started by pid 377 opentogethertube_redis | 377:C 20 Dec 2020 18:12:25.044 * DB saved on disk opentogethertube_redis | 377:C 20 Dec 2020 18:12:25.044 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:12:25.130 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:17:26.032 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:17:26.032 * Background saving started by pid 448 opentogethertube_redis | 448:C 20 Dec 2020 18:17:26.038 * DB saved on disk opentogethertube_redis | 448:C 20 Dec 2020 18:17:26.039 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:17:26.133 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:22:27.038 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:22:27.038 * Background saving started by pid 521 opentogethertube_redis | 521:C 20 Dec 2020 18:22:27.043 * DB saved on disk opentogethertube_redis | 521:C 20 Dec 2020 18:22:27.043 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:22:27.138 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:27:28.041 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:27:28.041 * Background saving started by pid 592 opentogethertube_redis | 592:C 20 Dec 2020 18:27:28.046 * DB saved on disk opentogethertube_redis | 592:C 20 Dec 2020 18:27:28.046 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:27:28.142 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:32:29.042 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:32:29.043 * Background saving started by pid 664 opentogethertube_redis | 664:C 20 Dec 2020 18:32:29.050 * DB saved on disk opentogethertube_redis | 664:C 20 Dec 2020 18:32:29.050 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:32:29.143 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:37:30.048 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:37:30.048 * Background saving started by pid 735 opentogethertube_redis | 735:C 20 Dec 2020 18:37:30.061 * DB saved on disk opentogethertube_redis | 735:C 20 Dec 2020 18:37:30.061 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:37:30.149 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:42:31.056 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:42:31.056 * Background saving started by pid 808 opentogethertube_redis | 808:C 20 Dec 2020 18:42:31.061 * DB saved on disk opentogethertube_redis | 808:C 20 Dec 2020 18:42:31.061 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:42:31.157 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:47:32.066 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:47:32.066 * Background saving started by pid 881 opentogethertube_redis | 881:C 20 Dec 2020 18:47:32.071 * DB saved on disk opentogethertube_redis | 881:C 20 Dec 2020 18:47:32.071 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:47:32.167 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:52:33.076 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:52:33.076 * Background saving started by pid 956 opentogethertube_redis | 956:C 20 Dec 2020 18:52:33.091 * DB saved on disk opentogethertube_redis | 956:C 20 Dec 2020 18:52:33.092 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:52:33.177 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 18:57:34.023 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 18:57:34.023 * Background saving started by pid 1028 opentogethertube_redis | 1028:C 20 Dec 2020 18:57:34.039 * DB saved on disk opentogethertube_redis | 1028:C 20 Dec 2020 18:57:34.039 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 18:57:34.124 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:02:35.027 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:02:35.028 * Background saving started by pid 1101 opentogethertube_redis | 1101:C 20 Dec 2020 19:02:35.041 * DB saved on disk opentogethertube_redis | 1101:C 20 Dec 2020 19:02:35.041 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:02:35.128 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:07:36.070 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:07:36.071 * Background saving started by pid 1174 opentogethertube_redis | 1174:C 20 Dec 2020 19:07:36.075 * DB saved on disk opentogethertube_redis | 1174:C 20 Dec 2020 19:07:36.075 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:07:36.171 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:12:37.079 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:12:37.080 * Background saving started by pid 1247 opentogethertube_redis | 1247:C 20 Dec 2020 19:12:37.086 * DB saved on disk opentogethertube_redis | 1247:C 20 Dec 2020 19:12:37.086 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:12:37.180 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:17:38.021 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:17:38.022 * Background saving started by pid 1319 opentogethertube_redis | 1319:C 20 Dec 2020 19:17:38.036 * DB saved on disk opentogethertube_redis | 1319:C 20 Dec 2020 19:17:38.036 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:17:38.122 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:22:39.079 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:22:39.079 * Background saving started by pid 1390 opentogethertube_redis | 1390:C 20 Dec 2020 19:22:39.085 * DB saved on disk opentogethertube_redis | 1390:C 20 Dec 2020 19:22:39.085 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:22:39.180 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:27:40.043 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:27:40.044 * Background saving started by pid 1462 opentogethertube_redis | 1462:C 20 Dec 2020 19:27:40.056 * DB saved on disk opentogethertube_redis | 1462:C 20 Dec 2020 19:27:40.056 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:27:40.144 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:32:41.006 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:32:41.007 * Background saving started by pid 1536 opentogethertube_redis | 1536:C 20 Dec 2020 19:32:41.021 * DB saved on disk opentogethertube_redis | 1536:C 20 Dec 2020 19:32:41.021 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:32:41.107 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:37:42.009 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:37:42.010 * Background saving started by pid 1608 opentogethertube_redis | 1608:C 20 Dec 2020 19:37:42.018 * DB saved on disk opentogethertube_redis | 1608:C 20 Dec 2020 19:37:42.018 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:37:42.110 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:42:43.077 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:42:43.078 * Background saving started by pid 1679 opentogethertube_redis | 1679:C 20 Dec 2020 19:42:43.082 * DB saved on disk opentogethertube_redis | 1679:C 20 Dec 2020 19:42:43.083 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:42:43.178 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:47:44.079 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:47:44.079 * Background saving started by pid 1752 opentogethertube_redis | 1752:C 20 Dec 2020 19:47:44.084 * DB saved on disk opentogethertube_redis | 1752:C 20 Dec 2020 19:47:44.084 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:47:44.180 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:52:45.080 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:52:45.081 * Background saving started by pid 1826 opentogethertube_redis | 1826:C 20 Dec 2020 19:52:45.093 * DB saved on disk opentogethertube_redis | 1826:C 20 Dec 2020 19:52:45.093 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:52:45.181 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 19:57:46.082 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 19:57:46.083 * Background saving started by pid 1900 opentogethertube_redis | 1900:C 20 Dec 2020 19:57:46.096 * DB saved on disk opentogethertube_redis | 1900:C 20 Dec 2020 19:57:46.097 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 19:57:46.183 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:02:47.080 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:02:47.081 * Background saving started by pid 1972 opentogethertube_redis | 1972:C 20 Dec 2020 20:02:47.096 * DB saved on disk opentogethertube_redis | 1972:C 20 Dec 2020 20:02:47.096 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:02:47.181 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:07:48.064 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:07:48.064 * Background saving started by pid 2046 opentogethertube_redis | 2046:C 20 Dec 2020 20:07:48.080 * DB saved on disk opentogethertube_redis | 2046:C 20 Dec 2020 20:07:48.080 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:07:48.165 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:12:49.063 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:12:49.063 * Background saving started by pid 2118 opentogethertube_redis | 2118:C 20 Dec 2020 20:12:49.075 * DB saved on disk opentogethertube_redis | 2118:C 20 Dec 2020 20:12:49.075 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:12:49.163 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:17:50.051 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:17:50.052 * Background saving started by pid 2191 opentogethertube_redis | 2191:C 20 Dec 2020 20:17:50.064 * DB saved on disk opentogethertube_redis | 2191:C 20 Dec 2020 20:17:50.065 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:17:50.152 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:22:51.057 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:22:51.058 * Background saving started by pid 2265 opentogethertube_redis | 2265:C 20 Dec 2020 20:22:51.062 * DB saved on disk opentogethertube_redis | 2265:C 20 Dec 2020 20:22:51.063 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:22:51.158 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:27:52.076 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:27:52.077 * Background saving started by pid 2338 opentogethertube_redis | 2338:C 20 Dec 2020 20:27:52.084 * DB saved on disk opentogethertube_redis | 2338:C 20 Dec 2020 20:27:52.084 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:27:52.177 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:32:53.023 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:32:53.023 * Background saving started by pid 2411 opentogethertube_redis | 2411:C 20 Dec 2020 20:32:53.037 * DB saved on disk opentogethertube_redis | 2411:C 20 Dec 2020 20:32:53.037 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:32:53.124 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:37:54.045 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:37:54.046 * Background saving started by pid 2483 opentogethertube_redis | 2483:C 20 Dec 2020 20:37:54.059 * DB saved on disk opentogethertube_redis | 2483:C 20 Dec 2020 20:37:54.059 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:37:54.146 * Background saving terminated with success opentogethertube_redis | 1:M 20 Dec 2020 20:42:55.041 * 100 changes in 300 seconds. Saving... opentogethertube_redis | 1:M 20 Dec 2020 20:42:55.042 * Background saving started by pid 2554 opentogethertube_redis | 2554:C 20 Dec 2020 20:42:55.050 * DB saved on disk opentogethertube_redis | 2554:C 20 Dec 2020 20:42:55.050 * RDB: 4 MB of memory used by copy-on-write opentogethertube_redis | 1:M 20 Dec 2020 20:42:55.142 * Background saving terminated with success opentogethertube_redis | 1:signal-handler (1608497224) Received SIGTERM scheduling shutdown... opentogethertube_redis | 1:M 20 Dec 2020 20:47:04.457 # User requested shutdown... opentogethertube_redis | 1:M 20 Dec 2020 20:47:04.457 * Saving the final RDB snapshot before exiting. opentogethertube_redis | 1:M 20 Dec 2020 20:47:04.462 * DB saved on disk opentogethertube_redis | 1:M 20 Dec 2020 20:47:04.462 # Redis is now ready to exit, bye bye... opentogethertube_redis | 1:C 20 Dec 2020 21:06:05.130 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo opentogethertube_redis | 1:C 20 Dec 2020 21:06:05.130 # Redis version=6.0.9, bits=64, commit=00000000, modified=0, pid=1, just started opentogethertube_redis | 1:C 20 Dec 2020 21:06:05.130 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 * Running mode=standalone, port=6379. opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 # Server initialized opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled (set to 'madvise' or 'never'). opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 * Loading RDB produced by version 6.0.9 opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 * RDB age 1141 seconds opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 * RDB memory usage when created 0.88 Mb opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 * DB loaded from disk: 0.000 seconds opentogethertube_redis | 1:M 20 Dec 2020 21:06:05.131 * Ready to accept connections opentogethertube_redis | 1:signal-handler (1608498631) Received SIGTERM scheduling shutdown... opentogethertube_redis | 1:M 20 Dec 2020 21:10:31.992 # User requested shutdown... opentogethertube_redis | 1:M 20 Dec 2020 21:10:31.992 * Saving the final RDB snapshot before exiting. opentogethertube_redis | 1:M 20 Dec 2020 21:10:31.997 * DB saved on disk opentogethertube_redis | 1:M 20 Dec 2020 21:10:31.998 # Redis is now ready to exit, bye bye... opentogethertube_redis | 1:C 20 Dec 2020 21:10:37.913 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo opentogethertube_redis | 1:C 20 Dec 2020 21:10:37.913 # Redis version=6.0.9, bits=64, commit=00000000, modified=0, pid=1, just started opentogethertube_redis | 1:C 20 Dec 2020 21:10:37.913 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 * Running mode=standalone, port=6379. opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 # Server initialized opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled (set to 'madvise' or 'never'). opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 * Loading RDB produced by version 6.0.9 opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 * RDB age 6 seconds opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.914 * RDB memory usage when created 0.93 Mb opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.915 * DB loaded from disk: 0.000 seconds opentogethertube_redis | 1:M 20 Dec 2020 21:10:37.915 * Ready to accept connections opentogethertube | opentogethertube | Sequelize CLI [Node: 14.15.1, CLI: 5.5.1, ORM: 5.21.4] opentogethertube | opentogethertube | Loaded configuration file "config/config.js". opentogethertube | Using environment "production". opentogethertube | opentogethertube | > opentogethertube@0.1.0 start /usr/app opentogethertube | > node app.js opentogethertube | opentogethertube | 2020-12-20 21:10:38 app info Reading config from production.env opentogethertube | 2020-12-20 21:10:38 app info Set log level to silly opentogethertube | 2020-12-20 21:10:38 app info Database mode: postgres opentogethertube | 2020-12-20 21:10:39 infoextract.ffprobe debug ffprobe installed at /usr/app/node_modules/@ffprobe-installer/linux-x64/ffprobe opentogethertube | 2020-12-20 21:10:39 app info Server started on port 8080 opentogethertube | 2020-12-20 21:10:39 roommanager info Connected to redis opentogethertube | 2020-12-20 21:10:39 roommanager info Redis client is ready opentogethertube | 2020-12-20 21:10:39 roommanager info Loaded 0 rooms from redis opentogethertube | 2020-12-20 21:10:40 roommanager debug [ws] CONNECTION ESTABLISHED opentogethertube | 2020-12-20 21:10:40 roommanager debug Looking for room open-not-existing-testroom-with-url in database opentogethertube | 2020-12-20 21:11:16 app debug Generated name for new user (on request): rich_harlequin_aphid opentogethertube | 2020-12-20 21:11:16 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:16 api info Getting queue add preview for search for video doesnt work opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): urgent_maroon_chipmunk opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): bad_gold_silkworm opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): broken_gray_mammal opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): popular_aqua_cattle opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): minimal_amethyst_echidna opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): friendly_amethyst_swan opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): underground_apricot_locust opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): statistical_coffee_bear opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): dry_rose_minnow opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): shocked_coffee_iguana opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): pale_white_guan opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): electoral_fuchsia_raven opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): young_jade_panda opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): mysterious_amethyst_echidna opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): big_maroon_cattle opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): gentle_coffee_python opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): current_sapphire_squirrel opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): regular_coffee_salamander opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): tight_red_louse opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): rainy_white_gull opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): monetary_jade_hawk opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): temporary_copper_aardvark opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): indian_azure_sparrow opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): panicky_teal_shrew opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): civilian_fuchsia_muskox opentogethertube | 2020-12-20 21:11:18 app debug Generated name for new user (on request): likely_jade_stoat opentogethertube | 2020-12-20 21:11:18 app info > GET /api/user opentogethertube | 2020-12-20 21:11:19 app debug Generated name for new user (on request): strategic_olive_lizard opentogethertube | 2020-12-20 21:11:19 app debug Generated name for new user (on request): painful_harlequin_wallaby opentogethertube | 2020-12-20 21:11:19 roommanager debug [ws] CONNECTION ESTABLISHED opentogethertube | 2020-12-20 21:11:19 roommanager debug Looking for room open-not-existing-testroom-with-url in database opentogethertube | 2020-12-20 21:11:19 app debug Generated name for new user (on request): shivering_aqua_swordtail opentogethertube | 2020-12-20 21:11:25 app debug Generated name for new user (on request): independent_emerald_beaver opentogethertube | 2020-12-20 21:11:25 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:25 api info Getting queue add preview for http://ww opentogethertube | 2020-12-20 21:11:25 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:28 app debug Generated name for new user (on request): burning_turquoise_lark opentogethertube | 2020-12-20 21:11:28 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:28 api info Getting queue add preview for http://www.youtube.com opentogethertube | 2020-12-20 21:11:28 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:28 app debug Generated name for new user (on request): minimal_moccasin_limpet opentogethertube | 2020-12-20 21:11:28 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:28 api info Getting queue add preview for http://www.youtube.com/ opentogethertube | 2020-12-20 21:11:28 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:30 app debug Generated name for new user (on request): regulatory_blue_boar opentogethertube | 2020-12-20 21:11:30 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:30 api info Getting queue add preview for http://www.youtube.com/url opentogethertube | 2020-12-20 21:11:30 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:37 app debug Generated name for new user (on request): atomic_gold_narwhal opentogethertube | 2020-12-20 21:11:37 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:37 api info Getting queue add preview for https://www.youtube.com/url opentogethertube | 2020-12-20 21:11:37 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:41 app debug Generated name for new user (on request): temporary_olive_jay opentogethertube | 2020-12-20 21:11:41 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:41 api info Getting queue add preview for https://youtube.com/url opentogethertube | 2020-12-20 21:11:41 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:45 app debug Generated name for new user (on request): unemployed_ivory_jellyfish opentogethertube | 2020-12-20 21:11:45 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:45 api info Getting queue add preview for https://youtube.com/url-doe opentogethertube | 2020-12-20 21:11:45 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:47 app debug Generated name for new user (on request): semantic_maroon_otter opentogethertube | 2020-12-20 21:11:47 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:47 api info Getting queue add preview for https://youtube.com/url-doesnt opentogethertube | 2020-12-20 21:11:47 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:48 app debug Generated name for new user (on request): monthly_amber_grouse opentogethertube | 2020-12-20 21:11:48 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:48 api info Getting queue add preview for https://youtube.com/url-doesnt-work opentogethertube | 2020-12-20 21:11:48 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:11:49 app debug Generated name for new user (on request): european_amaranth_louse opentogethertube | 2020-12-20 21:11:49 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:11:49 api info Getting queue add preview for https://youtube.com/url-doesnt-work-too opentogethertube | 2020-12-20 21:11:49 api error Unable to get add preview: UnsupportedServiceException opentogethertube | 2020-12-20 21:12:38 app debug Generated name for new user (on request): defiant_indigo_wildfowl opentogethertube | 2020-12-20 21:12:38 app info > GET /api/room/list opentogethertube | 2020-12-20 21:12:40 app debug Generated name for new user (on request): distinct_blush_quelea opentogethertube | 2020-12-20 21:12:40 app info > POST /api/room/generate opentogethertube | 2020-12-20 21:12:40 api debug Generating room: a179433a-b871-418f-b551-bba86816932e opentogethertube | 2020-12-20 21:12:40 roommanager silly Attempting to create a room with {"name":"a179433a-b871-418f-b551-bba86816932e","isTemporary":true,"visibility":"public"} opentogethertube | 2020-12-20 21:12:50 app debug Generated name for new user (on request): high_chocolate_kangaroo opentogethertube | 2020-12-20 21:12:50 app info > POST /api/room/create opentogethertube | 2020-12-20 21:12:50 roommanager silly Attempting to create a room with {"name":"Testroom","title":"","description":"","visibility":"public","queueMode":"manual","isTemporary":false} opentogethertube | 2020-12-20 21:16:59 app info > GET /api/data/previewAdd opentogethertube | 2020-12-20 21:16:59 api info Getting queue add preview for https://www.youtube.com/watch?v=bORGmFVxHJk
dyc3 commented 3 years ago

I just tried the same method you used, and was able to reproduce the issue. Switching this to a bug report.

dyc3 commented 3 years ago

Building the image from source seems to work fine:

docker-compose -f docker/docker-compose.yml --env-file env/production.env up
dyc3 commented 3 years ago

For some reason, npx sequelize-cli db:migrate is giving me:

ERROR: Dialect needs to be explicitly supplied as of v4.0.0

However, in the config, the dialect is supplied.

noxhirsch commented 3 years ago

Building the image from source seems to work fine:

docker-compose -f docker/docker-compose.yml --env-file env/production.env up

In my case, the problem stays the same when I build the image from source. I'm pretty sure I already tried that yesterday, but I tried it again with the same result. I don't think it helps, but for the sake of completeness I added the full console output of the build process: https://pastebin.com/fL9p4k7g (I had to put it on Pastebin, because apparently Github has a maximum of 65536 characters)

dyc3 commented 3 years ago

This is really strange. I've never had a problem like this. I tried clearing my docker image cache just to make sure, and I was still able to build the image from source just fine. It was able to run the migrations. I'm going to try publishing a new docker tag with my built image and we'll see if it works for you.

dyc3 commented 3 years ago

Ok, I've pushed the tag dyc3/opentogethertube:debug-344. In the top level docker-compose.yml, change the image: line to image: dyc3/opentogethertube:debug-344, and run it with docker-compose up.

noxhirsch commented 3 years ago

I've just edited the image line in docker-compose to image: dyc3/opentogethertube:debug-344 and it worked immediately. Adding rooms & videos and chatting seems to work perfectly fine this time 👍

dyc3 commented 3 years ago

That's good, but also very frustrating. Would you be willing to help me figure out what's going on with the latest image?

noxhirsch commented 3 years ago

I'm not a developer, so my knowledge is very very limited - but of course I'll do my best to help. For instance if you want me to test specific things & provide logs, that's no problem.

dyc3 commented 3 years ago

I found the issue, I think the current latest docker image is on an old commit. CI might not be pushing the images correctly?

dyc3 commented 3 years ago

The latest tag should be fixed now.

noxhirsch commented 3 years ago

I can confirm that 👍 Thank you very much!