search

toluaina / pgsync

Postgres to Elasticsearch/OpenSearch sync
https://pgsync.com
MIT License
1.15k stars 180 forks source link

docker-compose example issue #319

Closed thienlehieu closed 2 years ago

thienlehieu commented 2 years ago

Hi, i have an issue when running docker example on window 10.

Problem Description: run 'docker-compose up' command, then pgsync container failed to startup

Pgsync version: 2.3.1

Error Message:

Creating pgsync_postgres_1      ... done
Creating pgsync_redis_1         ... done
Creating pgsync_elasticsearch_1 ... done
Creating pgsync_pgsync_1        ... done
Attaching to pgsync_postgres_1, pgsync_redis_1, pgsync_elasticsearch_1, pgsync_pgsync_1
postgres_1       | The files belonging to this database system will be owned by user "postgres".
postgres_1       | This user must also own the server process.
postgres_1       |
postgres_1       | The database cluster will be initialized with locale "en_US.utf8".
postgres_1       | The default database encoding has accordingly been set to "UTF8".
postgres_1       | The default text search configuration will be set to "english".
postgres_1       |
postgres_1       | Data page checksums are disabled.
postgres_1       |
postgres_1       | fixing permissions on existing directory /var/lib/postgresql/data ... ok
postgres_1       | creating subdirectories ... ok
redis_1          | 1:C 27 Jul 2022 07:39:19.166 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
postgres_1       | selecting dynamic shared memory implementation ... posix
postgres_1       | selecting default max_connections ... 100
postgres_1       | selecting default shared_buffers ... 128MB
postgres_1       | selecting default time zone ... Etc/UTC
postgres_1       | creating configuration files ... ok
postgres_1       | running bootstrap script ... ok
redis_1          | 1:C 27 Jul 2022 07:39:19.167 # Redis version=7.0.4, bits=64, commit=00000000, modified=0, pid=1, just started
redis_1          | 1:C 27 Jul 2022 07:39:19.167 # Configuration loaded
redis_1          | 1:M 27 Jul 2022 07:39:19.168 * monotonic clock: POSIX clock_gettime
redis_1          | 1:M 27 Jul 2022 07:39:19.175 * Running mode=standalone, port=6379.
redis_1          | 1:M 27 Jul 2022 07:39:19.175 # Server initialized
redis_1          | 1:M 27 Jul 2022 07:39:19.176 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.    
redis_1          | 1:M 27 Jul 2022 07:39:19.323 * Ready to accept connections
pgsync_1         | wait-for-it.sh: waiting 60 seconds for postgres:5432
postgres_1       | performing post-bootstrap initialization ... ok
postgres_1       | syncing data to disk ... initdb: warning: enabling "trust" authentication for local connections
postgres_1       | You can change this by editing pg_hba.conf or using the option -A, or
postgres_1       | --auth-local and --auth-host, the next time you run initdb.
postgres_1       | ok
postgres_1       |
postgres_1       |
postgres_1       | Success. You can now start the database server using:
postgres_1       |
postgres_1       |     pg_ctl -D /var/lib/postgresql/data -l logfile start
postgres_1       |
postgres_1       | waiting for server to start....2022-07-27 07:39:31.809 GMT [54] LOG:  starting PostgreSQL 14.4 (Debian 14.4-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
postgres_1       | 2022-07-27 07:39:31.969 GMT [54] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres_1       | 2022-07-27 07:39:32.403 GMT [55] LOG:  database system was shut down at 2022-07-27 07:39:29 GMT
postgres_1       | .2022-07-27 07:39:32.523 GMT [54] LOG:  database system is ready to accept connections
postgres_1       |  done
postgres_1       | server started
postgres_1       | CREATE DATABASE
postgres_1       |
postgres_1       | 
postgres_1       | /usr/local/bin/docker-entrypoint.sh: sourcing /docker-entrypoint-initdb.d/init-permissions.sh
postgres_1       |
postgres_1       | waiting for server to shut down....2022-07-27 07:40:11.551 GMT [54] LOG:  received fast shutdown request
postgres_1       | 2022-07-27 07:40:11.996 GMT [54] LOG:  aborting any active transactions
postgres_1       | 2022-07-27 07:40:12.023 GMT [54] LOG:  background worker "logical replication launcher" (PID 61) exited with exit code 1
postgres_1       | 2022-07-27 07:40:12.023 GMT [56] LOG:  shutting down
postgres_1       | ..2022-07-27 07:40:14.357 GMT [54] LOG:  database system is shut down
postgres_1       |  done
postgres_1       | server stopped
postgres_1       |
postgres_1       | PostgreSQL init process complete; ready for start up.
postgres_1       |
postgres_1       | 2022-07-27 07:40:15.317 GMT [1] LOG:  starting PostgreSQL 14.4 (Debian 14.4-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
postgres_1       | 2022-07-27 07:40:15.519 GMT [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
postgres_1       | 2022-07-27 07:40:15.601 GMT [1] LOG:  listening on IPv6 address "::", port 5432
pgsync_1         | wait-for-it.sh: postgres:5432 is available after 48 seconds
postgres_1       | 2022-07-27 07:40:16.201 GMT [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
pgsync_1         | wait-for-it.sh: waiting 60 seconds for elasticsearch:9200
postgres_1       | 2022-07-27 07:40:17.163 GMT [69] LOG:  incomplete startup packet
postgres_1       | 2022-07-27 07:40:17.163 GMT [68] LOG:  database system was shut down at 2022-07-27 07:40:13 GMT
postgres_1       | 2022-07-27 07:40:17.424 GMT [1] LOG:  database system is ready to accept connections
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:17,643Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "version[7.17.4], pid[7], build[default/docker/79878662c54c886ae89206c685d9f1051a9d6411/2022-05-18T18:04:20.964345128Z], OS[Linux/5.10.16.3-microsoft-standard-WSL2/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/18.0.1.1/18.0.1.1+2-6]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:17,878Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:17,879Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -Djava.security.manager=allow, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-5172327982982840222, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms3131m, -Xmx3131m, -XX:MaxDirectMemorySize=1642070016, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,772Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [aggs-matrix-stats]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,773Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [analysis-common]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,775Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [constant-keyword]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,778Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [frozen-indices]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,781Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [ingest-common]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,782Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [ingest-geoip]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,782Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [ingest-user-agent]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,783Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [kibana]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,783Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [lang-expression]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,783Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [lang-mustache]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,784Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [lang-painless]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,784Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [legacy-geo]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,785Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [mapper-extras]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,785Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [mapper-version]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,786Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [parent-join]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,786Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [percolator]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,787Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [rank-eval]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,787Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [reindex]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,788Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [repositories-metering-api]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,788Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [repository-encrypted]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,789Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [repository-url]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,790Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [runtime-fields-common]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,796Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [search-business-rules]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,801Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [searchable-snapshots]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,802Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [snapshot-repo-test-kit]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,803Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [spatial]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,803Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [transform]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,804Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [transport-netty4]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,804Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [unsigned-long]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,805Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [vector-tile]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,807Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [vectors]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,807Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [wildcard]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,808Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-aggregate-metric]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,809Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-analytics]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,810Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-async]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,811Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-async-search]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,811Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-autoscaling]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,814Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-ccr]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,816Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-core]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,817Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-data-streams]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,818Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-deprecation]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,819Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-enrich]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,820Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-eql]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,820Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-fleet]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,821Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-graph]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,822Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-identity-provider]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,822Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-ilm]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,823Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-logstash]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,823Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-ml]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,824Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-monitoring]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,825Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-ql]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,825Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-rollup]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,826Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-security]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,826Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-shutdown]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,827Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-sql]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,828Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-stack]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,828Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-text-structure]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,832Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-voting-only-node]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,834Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "loaded module [x-pack-watcher]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:25,837Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "no plugins loaded" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:26,461Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "using [1] data paths, mounts [[/ (overlay)]], net usable_space [223.8gb], net total_space [250.9gb], types [overlay]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:26,462Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "heap size [3gb], compressed ordinary object pointers [true]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:26,598Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "node name [3ad0fd961499], node ID [pPjOKqNVQEO-66HDM_az7g], cluster name [docker-cluster], roles [transform, data_frozen, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:49,027Z", "level": "INFO", "component": "o.e.x.m.p.l.CppLogMessageHandler", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "[controller/215] [Main.cc@122] controller (64 bit): Version 7.17.4 (Build 57e42dc012e06b) Copyright (c) 2022 Elasticsearch BV" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:50,203Z", "level": "INFO", "component": "o.e.i.g.ConfigDatabases", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "initialized default databases [[GeoLite2-Country.mmdb, GeoLite2-City.mmdb, GeoLite2-ASN.mmdb]], config databases [[]] and watching [/usr/share/elasticsearch/config/ingest-geoip] for changes" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:50,208Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "initialized database registry, using geoip-databases directory [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:51,739Z", "level": "INFO", "component": "o.e.t.NettyAllocator", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "creating NettyAllocator with the following configs: [name=elasticsearch_configured, chunk_size=1mb, suggested_max_allocation_size=1mb, factors={es.unsafe.use_netty_default_chunk_and_page_size=false, g1gc_enabled=true, g1gc_region_size=4mb}]" }        
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:51,795Z", "level": "INFO", "component": "o.e.i.r.RecoverySettings", "cluster.name": 
"docker-cluster", "node.name": "3ad0fd961499", "message": "using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:51,916Z", "level": "INFO", "component": "o.e.d.DiscoveryModule", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "using discovery type [zen] and seed hosts providers [settings]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:53,565Z", "level": "INFO", "component": "o.e.g.DanglingIndicesState", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:54,897Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "initialized" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:54,897Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "starting ..." }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,182Z", "level": "INFO", "component": "o.e.x.s.c.f.PersistentCache", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "persistent cache index loaded" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,183Z", "level": "INFO", "component": "o.e.x.d.l.DeprecationIndexingComponent", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "deprecation component started" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,620Z", "level": "INFO", "component": "o.e.t.TransportService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "publish_address {127.0.0.1:9300}, bound_addresses {127.0.0.1:9300}" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,654Z", "level": "INFO", "component": "o.e.x.m.Monitoring", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "creating template [.monitoring-alerts-7] with version [7]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,678Z", "level": "INFO", "component": "o.e.x.m.Monitoring", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "creating template [.monitoring-es] with version [7]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,681Z", "level": "INFO", "component": "o.e.x.m.Monitoring", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "creating template [.monitoring-kibana] with version [7]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,689Z", "level": "INFO", "component": "o.e.x.m.Monitoring", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "creating template [.monitoring-logstash] with version [7]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:55,699Z", "level": "INFO", "component": "o.e.x.m.Monitoring", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "creating template [.monitoring-beats] with version [7]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:56,959Z", "level": "WARN", "component": "o.e.b.BootstrapChecks", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]" }   
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:56,961Z", "level": "WARN", "component": "o.e.b.BootstrapChecks", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:40:57,000Z", "level": "INFO", "component": "o.e.c.c.ClusterBootstrapService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "no discovery configuration found, will perform best-effort cluster bootstrapping after 
[3s] unless existing master is discovered" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:00,004Z", "level": "INFO", "component": "o.e.c.c.Coordinator", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "setting initial configuration to VotingConfiguration{pPjOKqNVQEO-66HDM_az7g}" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:02,004Z", "level": "INFO", "component": "o.e.c.s.MasterService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "elected-as-master ([1] nodes joined)[{3ad0fd961499}{pPjOKqNVQEO-66HDM_az7g}{ILwrxVr3RACusidJl8kNOg}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{3ad0fd961499}{pPjOKqNVQEO-66HDM_az7g}{ILwrxVr3RACusidJl8kNOg}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw}]}" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:02,799Z", "level": "INFO", "component": "o.e.c.c.CoordinationState", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "cluster UUID set to [S4KBLaQXTAW0Kib40hrHiw]" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:03,357Z", "level": "INFO", "component": "o.e.c.s.ClusterApplierService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "master node changed {previous [], current [{3ad0fd961499}{pPjOKqNVQEO-66HDM_az7g}{ILwrxVr3RACusidJl8kNOg}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw}]}, term: 1, version: 1, reason: Publication{term=1, version=1}" }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:03,463Z", "level": "INFO", "component": "o.e.h.AbstractHttpServerTransport", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "publish_address {192.168.176.2:9200}, bound_addresses {0.0.0.0:9200}", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:03,465Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "started", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
pgsync_1         | wait-for-it.sh: elasticsearch:9200 is available after 47 seconds
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:04,174Z", "level": "INFO", "component": "o.e.g.GatewayService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "recovered [0] indices into cluster_state", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
pgsync_1         | wait-for-it.sh: waiting 60 seconds for redis:6379
pgsync_1         | wait-for-it.sh: redis:6379 is available after 0 seconds
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:04,778Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.ml-notifications-000002] for index patterns [.ml-notifications-000002]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:05,947Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.ml-state] for index patterns [.ml-state*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:08,406Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.ml-anomalies-] for index patterns [.ml-anomalies-*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:09,973Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.ml-stats] for index patterns [.ml-stats-*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:12,247Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [data-streams-mappings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:13,658Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [metrics-settings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:14,878Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [logs-settings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:16,552Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [metrics-mappings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:17,908Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [logs-mappings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:19,413Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [synthetics-mappings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:21,080Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [synthetics-settings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:22,603Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.watch-history-13] for index patterns [.watcher-history-13*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:24,850Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [ilm-history] for index patterns [ilm-history-5*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:26,597Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [.deprecation-indexing-mappings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:27,980Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding component template [.deprecation-indexing-settings]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:28,998Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.slm-history] for index patterns [.slm-history-5*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:30,102Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [metrics] for index patterns [metrics-*-*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:31,032Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [logs] for index patterns [logs-*-*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:32,537Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [synthetics] for index patterns [synthetics-*-*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:34,065Z", "level": "INFO", "component": "o.e.c.m.MetadataIndexTemplateService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index template [.deprecation-indexing-template] for index patterns [.logs-deprecation.*]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:34,179Z", "level": "ERROR", "component": "o.e.x.m.e.l.LocalExporter", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "failed to set monitoring pipeline [xpack_monitoring_7]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g" ,
elasticsearch_1  | "stacktrace": ["org.elasticsearch.cluster.metadata.ProcessClusterEventTimeoutException: failed to process cluster event (put-pipeline-xpack_monitoring_7) within 30s",
elasticsearch_1  | "at org.elasticsearch.cluster.service.MasterService$Batcher.lambda$onTimeout$0(MasterService.java:158) [elasticsearch-7.17.4.jar:7.17.4]",
elasticsearch_1  | "at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]",
elasticsearch_1  | "at org.elasticsearch.cluster.service.MasterService$Batcher.lambda$onTimeout$1(MasterService.java:157) [elasticsearch-7.17.4.jar:7.17.4]",
elasticsearch_1  | "at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:718) [elasticsearch-7.17.4.jar:7.17.4]",
elasticsearch_1  | "at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]",
elasticsearch_1  | "at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]",
elasticsearch_1  | "at java.lang.Thread.run(Thread.java:833) [?:?]"] }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:34,808Z", "level": "ERROR", "component": "o.e.x.m.e.l.LocalExporter", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "failed to set monitoring pipeline [xpack_monitoring_6]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g" ,
elasticsearch_1  | "stacktrace": ["org.elasticsearch.cluster.metadata.ProcessClusterEventTimeoutException: failed to process cluster event (put-pipeline-xpack_monitoring_6) within 30s",
elasticsearch_1  | "at org.elasticsearch.cluster.service.MasterService$Batcher.lambda$onTimeout$0(MasterService.java:158) [elasticsearch-7.17.4.jar:7.17.4]",
elasticsearch_1  | "at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]",
elasticsearch_1  | "at org.elasticsearch.cluster.service.MasterService$Batcher.lambda$onTimeout$1(MasterService.java:157) [elasticsearch-7.17.4.jar:7.17.4]",
elasticsearch_1  | "at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:718) [elasticsearch-7.17.4.jar:7.17.4]",
elasticsearch_1  | "at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]",
elasticsearch_1  | "at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]",
elasticsearch_1  | "at java.lang.Thread.run(Thread.java:833) [?:?]"] }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:35,355Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [ml-size-based-ilm-policy]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:37,475Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [synthetics]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:39,051Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [logs]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", 
"node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:40,393Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [7-days-default]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:41,793Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [metrics]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:42,885Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [30-days-default]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:44,344Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [365-days-default]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:45,649Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [90-days-default]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:46,899Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [180-days-default]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:48,230Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [watch-history-ilm-policy]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:49,431Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [ilm-history-ilm-policy]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:50,699Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [slm-history-ilm-policy]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:51,875Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [.deprecation-indexing-ilm-policy]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:53,543Z", "level": "INFO", "component": "o.e.x.i.a.TransportPutLifecycleAction", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "adding index lifecycle policy [.fleet-actions-results-ilm-policy]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:57,428Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "updating geoip databases", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:41:57,430Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "fetching geoip databases overview from [https://geoip.elastic.co/v1/database?elastic_geoip_service_tos=agree]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:42:09,155Z", "level": "INFO", "component": "o.e.l.LicenseService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "license [70d24ad8-d9c0-42f9-9840-d965fdd4d6b3] mode [basic] - valid", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:42:25,635Z", "level": "INFO", "component": "o.e.c.m.MetadataCreateIndexService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "[.geoip_databases] creating index, cause [auto(bulk api)], templates [], shards [1]/[0]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:42:36,912Z", "level": "INFO", "component": "o.e.c.r.a.AllocationService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.geoip_databases][0]]]).", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:43:08,686Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "retrieve geoip database [GeoLite2-ASN.mmdb] from [.geoip_databases] to [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g/GeoLite2-ASN.mmdb.tmp.gz]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:43:08,762Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "successfully downloaded geoip database [GeoLite2-ASN.mmdb]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
pgsync_1         | Traceback (most recent call last):
pgsync_1         |   File "examples/airbnb/schema.py", line 119, in <module>
pgsync_1         |     main()
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1130, in __call__
pgsync_1         |     return self.main(*args, **kwargs)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1055, in main
pgsync_1         |     rv = self.invoke(ctx)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1404, in invoke
pgsync_1         |     return ctx.invoke(self.callback, **ctx.params)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 760, in invoke
pgsync_1         |     return __callback(*args, **kwargs)
pgsync_1         |   File "examples/airbnb/schema.py", line 115, in main
pgsync_1         |     setup(config)
pgsync_1         |   File "examples/airbnb/schema.py", line 99, in setup
pgsync_1         |     with pg_engine(database) as engine:
pgsync_1         | AttributeError: __enter__
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:43:12,537Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "successfully reloaded changed geoip database file [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g/GeoLite2-ASN.mmdb]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
pgsync_1         | Traceback (most recent call last):
pgsync_1         |   File "examples/airbnb/data.py", line 213, in <module>
pgsync_1         |     main()
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1130, in __call__
pgsync_1         |     return self.main(*args, **kwargs)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1055, in main
pgsync_1         |     rv = self.invoke(ctx)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1404, in invoke
pgsync_1         |     return ctx.invoke(self.callback, **ctx.params)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 760, in invoke
pgsync_1         |     return __callback(*args, **kwargs)
pgsync_1         |   File "examples/airbnb/data.py", line 27, in main
pgsync_1         |     documents[0].get("database", documents[0]["index"])
pgsync_1         | AttributeError: __enter__
pgsync_1         | Traceback (most recent call last):
pgsync_1         |   File "/usr/local/bin/bootstrap", line 70, in <module>
pgsync_1         |     main()
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1130, in __call__
pgsync_1         |     return self.main(*args, **kwargs)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1055, in main
pgsync_1         |     rv = self.invoke(ctx)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1404, in invoke
pgsync_1         |     return ctx.invoke(self.callback, **ctx.params)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 760, in invoke
pgsync_1         |     return __callback(*args, **kwargs)
pgsync_1         |   File "/usr/local/bin/bootstrap", line 60, in main
pgsync_1         |     document, verbose=verbose, repl_slots=False, **kwargs
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/sync.py", line 107, in __init__
pgsync_1         |     self.validate(repl_slots=repl_slots)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/sync.py", line 194, in validate
pgsync_1         |     self.root.display()
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/sync.py", line 117, in root
pgsync_1         |     self.__root = self.tree.build(self.nodes)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/node.py", line 257, in build
pgsync_1         |     model=self.base.model(table, schema=schema),
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/base.py", line 168, in model
pgsync_1         |     f'Table "{name}" not found in registry'
pgsync_1         | pgsync.exc.TableNotFoundError: 'Table "public.user" not found in registry'
pgsync_1         |  0:00:00.103946 (0.10 sec)
pgsync_1         | Traceback (most recent call last):
pgsync_1         |   File "/usr/local/bin/pgsync", line 7, in <module>
pgsync_1         |     sync.main()
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1130, in __call__
pgsync_1         |     return self.main(*args, **kwargs)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1055, in main
pgsync_1         |     rv = self.invoke(ctx)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1404, in invoke
pgsync_1         |     return ctx.invoke(self.callback, **ctx.params)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/click/core.py", line 760, in invoke
pgsync_1         |     return __callback(*args, **kwargs)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/sync.py", line 1394, in main
pgsync_1         |     sync: Sync = Sync(document, verbose=verbose, **kwargs)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/sync.py", line 107, in __init__
pgsync_1         |     self.validate(repl_slots=repl_slots)
pgsync_1         |   File "/usr/local/lib/python3.7/site-packages/pgsync/sync.py", line 177, in validate
pgsync_1         |     f'Replication slot "{self.__name}" does not exist.\n'
pgsync_1         | RuntimeError: Replication slot "airbnb_airbnb" does not exist.
pgsync_1         | Make sure you have run the "bootstrap" command.
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:44:19,305Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "retrieve geoip database [GeoLite2-City.mmdb] from [.geoip_databases] to [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g/GeoLite2-City.mmdb.tmp.gz]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:44:19,394Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "successfully downloaded geoip database [GeoLite2-City.mmdb]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:44:27,576Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "successfully reloaded changed geoip database file [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g/GeoLite2-City.mmdb]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:44:41,026Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "retrieve geoip database [GeoLite2-Country.mmdb] from [.geoip_databases] to [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g/GeoLite2-Country.mmdb.tmp.gz]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:44:41,057Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "successfully downloaded geoip database [GeoLite2-Country.mmdb]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
elasticsearch_1  | {"type": "server", "timestamp": "2022-07-27T07:44:41,666Z", "level": "INFO", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "docker-cluster", "node.name": "3ad0fd961499", "message": "successfully reloaded changed geoip database file [/tmp/elasticsearch-5172327982982840222/geoip-databases/pPjOKqNVQEO-66HDM_az7g/GeoLite2-Country.mmdb]", "cluster.uuid": "S4KBLaQXTAW0Kib40hrHiw", "node.id": "pPjOKqNVQEO-66HDM_az7g"  }
pgsync_pgsync_1 exited with code 1
thienlehieu commented 2 years ago

it works fine if i switch pgsync version back to 2.3.0

toluaina commented 2 years ago

Sorry about this. I made some changes to the code on master and have not published a new version since then. It should be ok now if you re try.

thienlehieu commented 2 years ago

i see that its working fine now, thank you.