Open Dyad-ITSS opened 1 year ago
Hello @Dyad-ITSS can you check the Caddy server logs? This loop might be a sign of issues with the certificate generation by caddy.
If this is the case, please check the domain configuration and that it is pointing to the right VM IP and that the following ports are open:
TCP ports 80 and 443 and UDP ports: 3478, 49152-65535.
That was it - thanks. Somehow Caddy was looking at the wrong domain. Even though I specified the correct domain in the script process.
Dumped the VPS, started fresh and it's up.
Thanks.
Hello @Dyad-ITSS can you check the Caddy server logs? This loop might be a sign of issues with the certificate generation by caddy.
If this is the case, please check the domain configuration and that it is pointing to the right VM IP and that the following ports are open:
TCP ports 80 and 443 and UDP ports: 3478, 49152-65535.
Hello @mlsmaycon I've try open the ports mentioned above but still lead to the "Waiting for Zitadel loop". Try different VPS and still the same. Could be any reason?
@duanyunlun do you have any logs about the certificates in caddy?
Can you share the logs from Zitadel and Caddy?
@duanyunlun do you have any logs about the certificates in caddy?
Can you share the logs from Zitadel and Caddy?
Sorry for the logs lost, how can I take the logs from docker? where is the files' location?
You can run:
docker compose logs caddy > caddy.log 2>&1
docker compose logs zitadel > zitadel.log 2>&1
Hello @duanyunlun the error seems to be related to firewall, the following request is failing:
Fetching http://net.liekong1991.cn/.well-known/acme-challenge/m1rLBDKI2mT_CjJJxy7B4nOWp-ZcdcO9FJGYqyziFkI: Connection refused
log even:
{"level":"error","ts":1701254942.4022658,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"net.liekong1991.cn","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:connection - 103.153.139.60: **Fetching http://net.liekong1991.cn/.well-known/acme-challenge/m1rLBDKI2mT_CjJJxy7B4nOWp-ZcdcO9FJGYqyziFkI: Connection refused**"}
Can you make sure that port 80 is open?
Hi, @mlsmaycon I've already open all the ports on the VPS firewall.
Here's the firewall setting, all needed ports are set to both TCP AND UDP with IN AND OUT.
I cannot reach these ports. Can you confirm that they are accessible?
It could be filtered in another layer, perhaps a local system firewall like firewalld
I can't confirm what firewall could be there 'cause the VPS has been reset many times. The system is Ubuntu22.04 LTS and I didn't install any software unless the required softs of netbird self-hosted deployment.
What is very strange is that after I changed VPS from several cloud service providers, I finally found one that worked. The firewall settings between them are exactly the same
hi, i got the same problem trying to selfhost in my local network,
this is my caddy log:
{"level":"debug","ts":1702034098.8644276,"logger":"tls.handshake","msg":"no matching certificates and no custom selection logic","identifier":"172.18.0.3"} {"level":"debug","ts":1702034098.8644433,"logger":"tls.handshake","msg":"no certificate matching TLS ClientHello","remote_ip":"172.16.21.221","remote_port":"43018","server_name":"","remote":"172.16.21.221:43018","identifier":"172.18.0.3","cipher_suites":[4866,4867,4865,49196,49200,159,52393,52392,52394,49195,49199,158,49188,49192,107,49187,49191,103,49162,49172,57,49161,49171,51,157,156,61,60,53,47,255],"cert_cache_fill":0.0001,"load_or_obtain_if_necessary":true,"on_demand":false} {"level":"debug","ts":1702034098.864522,"logger":"http.stdlib","msg":"http: TLS handshake error from 172.16.21.221:43018: no certificate available for '172.18.0.3'"}
maybe i dont know but can i run netbird with my local ip ? i just want to test the server locally first, thanks
@BlackBatM4n I don't think you can setup it on local network
You can run netbird locally on Linux, Mac and windows with caddy and local domains fully utilising HTTPS using this.
export NETBIRD_DOMAIN=netbird.local
HOST_PROFILE=netbird
HOSTS_FILE=$(PWD)/.etchosts
### setup hosts file so caddy works woth local URLS and HTTPS
host-init:
# install hostsctl
go install github.com/guumaster/hostctl/cmd/hostctl@latest
# create the ./etchosts
@echo $(NETBIRD_DOMAIN)
rm -rf $(HOSTS_FILE)
@echo "127.0.0.1 $(NETBIRD_DOMAIN)" >> $(HOSTS_FILE)
host-run:
# https://guumaster.github.io/hostctl/docs/guides/basic_profiles/
sudo hostctl replace $(HOST_PROFILE) --from $(HOSTS_FILE)
host-run-del:
sudo hostctl remove $(HOST_PROFILE)
hostctl list
host-ls:
hostctl list
You can run netbird locally on Linux, Mac and windows with caddy and local domains fully utilising HTTPS using this.
export NETBIRD_DOMAIN=netbird.local HOST_PROFILE=netbird HOSTS_FILE=$(PWD)/.etchosts ### setup hosts file so caddy works woth local URLS and HTTPS host-init: # install hostsctl go install github.com/guumaster/hostctl/cmd/hostctl@latest # create the ./etchosts @echo $(NETBIRD_DOMAIN) rm -rf $(HOSTS_FILE) @echo "127.0.0.1 $(NETBIRD_DOMAIN)" >> $(HOSTS_FILE) host-run: # https://guumaster.github.io/hostctl/docs/guides/basic_profiles/ sudo hostctl replace $(HOST_PROFILE) --from $(HOSTS_FILE) host-run-del: sudo hostctl remove $(HOST_PROFILE) hostctl list host-ls: hostctl list
how would I integrate this with the quickstart script or advanced self-hosted scripts from infrastructure_files
? by editing an existing script, .env file, docker / whatever yml file, or by adding a new file (script/env/yml) ..?
@Dyad-ITSS are you able to solve the issue, i have the same issue, i am stuck with Zitadel to become ready LOOP, what to do
@itsmejomijohn , try installing an older version, it helped me to solve the issue.
@Dyad-ITSS, when the script is stuck in this loop, it usually means that there is a problem with the certificate; you can have a look at the caddy logs to find out more. If there is nothing there, please share all logs from:
docker compose logs
I am having the same issue
[ingo@Docker02 docker]$ export NETBIRD_DOMAIN=netbird.grayhatlabs.com; curl -fsSL https://github.com/netbirdio/netbird/releases/latest/download/getting-started-with-zitadel.sh | bash Use Postgres as default Zitadel database. For using CockroachDB please the environment variable 'export ZITADEL_DATABASE=cockroach'. Rendering initial files...
Starting Zitadel IDP for user management
WARN[0000] /home/ingo/docker/docker-compose.yml: the attribute version
is obsolete, it will be ignored, please remove it to avoid potential confusion
[+] Running 7/7
✔ Network docker_netbird Created 0.1s
✔ Volume "docker_netbird_zitadel_certs" Created 0.0s
✔ Volume "docker_netbird_zdb_data" Created 0.0s
✔ Volume "docker_netbird_caddy_data" Created 0.0s
✔ Container docker-zdb-1 Healthy 5.9s
✔ Container docker-caddy-1 Started 0.4s
✔ Container docker-zitadel-1 Started 6.1s
Initializing Zitadel with NetBird's applications
Waiting for Zitadel's PAT to be created . . done Reading Zitadel PAT Waiting for Zitadel to become ready . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
[ingo@Docker02 docker]$ docker compose logs
WARN[0000] /home/ingo/docker/docker-compose.yml: the attribute version
is obsolete, it will be ignored, please remove it to avoid potential confusion
zdb-1 | The files belonging to this database system will be owned by user "postgres".
zdb-1 | This user must also own the server process.
zdb-1 |
zdb-1 | The database cluster will be initialized with locale "en_US.utf8".
zdb-1 | The default database encoding has accordingly been set to "UTF8".
zdb-1 | The default text search configuration will be set to "english".
zdb-1 |
zdb-1 | Data page checksums are disabled.
zdb-1 |
zdb-1 | fixing permissions on existing directory /var/lib/postgresql/data ... ok
zdb-1 | creating subdirectories ... ok
zdb-1 | selecting dynamic shared memory implementation ... posix
zdb-1 | selecting default max_connections ... 100
zdb-1 | selecting default shared_buffers ... 128MB
zdb-1 | selecting default time zone ... UTC
zdb-1 | creating configuration files ... ok
zdb-1 | running bootstrap script ... ok
zdb-1 | sh: locale: not found
zdb-1 | 2024-09-06 21:12:34.646 UTC [35] WARNING: no usable system locales were found
zdb-1 | performing post-bootstrap initialization ... ok
zdb-1 | syncing data to disk ... ok
zdb-1 |
zdb-1 |
zdb-1 | Success. You can now start the database server using:
zdb-1 |
zdb-1 | pg_ctl -D /var/lib/postgresql/data -l logfile start
zdb-1 |
zdb-1 | initdb: warning: enabling "trust" authentication for local connections
zdb-1 | initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.
zdb-1 | waiting for server to start....2024-09-06 21:12:36.816 UTC [41] LOG: starting PostgreSQL 16.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 13.2.1_git20240309) 13.2.1 20240309, 64-bit
zdb-1 | 2024-09-06 21:12:36.819 UTC [41] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
zdb-1 | 2024-09-06 21:12:36.828 UTC [44] LOG: database system was shut down at 2024-09-06 21:12:34 UTC
zdb-1 | 2024-09-06 21:12:36.833 UTC [41] LOG: database system is ready to accept connections
zdb-1 | done
zdb-1 | server started
zdb-1 | CREATE DATABASE
zdb-1 |
zdb-1 |
zdb-1 | /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/
zdb-1 |
zdb-1 | waiting for server to shut down....2024-09-06 21:12:36.942 UTC [41] LOG: received fast shutdown request
zdb-1 | 2024-09-06 21:12:36.945 UTC [41] LOG: aborting any active transactions
zdb-1 | 2024-09-06 21:12:36.946 UTC [41] LOG: background worker "logical replication launcher" (PID 47) exited with exit code 1
zdb-1 | 2024-09-06 21:12:36.946 UTC [42] LOG: shutting down
zdb-1 | 2024-09-06 21:12:36.950 UTC [42] LOG: checkpoint starting: shutdown immediate
zdb-1 | 2024-09-06 21:12:37.571 UTC [42] LOG: checkpoint complete: wrote 924 buffers (5.6%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.018 s, sync=0.590 s, total=0.625 s; sync files=301, longest=0.011 s, average=0.002 s; distance=4267 kB, estimate=4267 kB; lsn=0/191AB58, redo lsn=0/191AB58
zdb-1 | 2024-09-06 21:12:37.573 UTC [41] LOG: database system is shut down
zdb-1 | done
zdb-1 | server stopped
zdb-1 |
zdb-1 | PostgreSQL init process complete; ready for start up.
zdb-1 |
zdb-1 | 2024-09-06 21:12:37.658 UTC [1] LOG: starting PostgreSQL 16.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 13.2.1_git20240309) 13.2.1 20240309, 64-bit
zdb-1 | 2024-09-06 21:12:37.658 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
zdb-1 | 2024-09-06 21:12:37.658 UTC [1] LOG: listening on IPv6 address "::", port 5432
zdb-1 | 2024-09-06 21:12:37.665 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
zdb-1 | 2024-09-06 21:12:37.672 UTC [57] LOG: database system was shut down at 2024-09-06 21:12:37 UTC
zdb-1 | 2024-09-06 21:12:37.677 UTC [1] LOG: database system is ready to accept connections
caddy-1 | {"level":"info","ts":1725657154.4168,"msg":"using config from file","file":"/etc/caddy/Caddyfile"}
caddy-1 | {"level":"info","ts":1725657154.4185278,"msg":"adapted config to JSON","adapter":"caddyfile"}
caddy-1 | {"level":"warn","ts":1725657154.4185376,"msg":"Caddyfile input is not formatted; run 'caddy fmt --overwrite' to fix inconsistencies","adapter":"caddyfile","file":"/etc/caddy/Caddyfile","line":2}
caddy-1 | {"level":"info","ts":1725657154.420839,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//[::1]:2019","//127.0.0.1:2019","//localhost:2019"]}
caddy-1 | {"level":"info","ts":1725657154.4210525,"logger":"http.auto_https","msg":"server is listening only on the HTTPS port but has no TLS connection policies; adding one to enable TLS","server_name":"srv0","https_port":443}
caddy-1 | {"level":"info","ts":1725657154.4210615,"logger":"http.auto_https","msg":"enabling automatic HTTP->HTTPS redirects","server_name":"srv0"}
caddy-1 | {"level":"warn","ts":1725657154.4211397,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv1","http_port":80}
caddy-1 | {"level":"info","ts":1725657154.4212544,"logger":"tls.cache.maintenance","msg":"started background certificate maintenance","cache":"0xc0008f0c80"}
caddy-1 | {"level":"debug","ts":1725657154.4211934,"logger":"http.auto_https","msg":"adjusted config","tls":{"automation":{"policies":[{}]}},"http":{"servers":{"srv0":{"listen":[":443"],"routes":[{"handle":[{"handler":"subroute","routes":[{"handle":[{"handler":"headers","response":{"deferred":true,"delete":["Server"],"set":{"Referrer-Policy":["strict-origin-when-cross-origin"],"Strict-Transport-Security":["max-age=3600; includeSubDomains; preload"],"X-Content-Type-Options":["nosniff"],"X-Frame-Options":["DENY"],"X-Xss-Protection":["1; mode=block"]}}}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.management.v1.ManagementService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.system.v1.SystemService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/.well-known/openid-configuration"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"signal:10000"}]}],"match":[{"path":["/signalexchange.SignalExchange/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.admin.v1.AdminService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"management:80"}]}],"match":[{"path":["/management.ManagementService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.auth.v1.AuthService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/management/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/system/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/assets/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/admin/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/oauth/v2/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/auth/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/oidc/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/saml/v2/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/openapi/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/device/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/debug/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/device"]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"management:80"}]}],"match":[{"path":["/api/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/ui/"]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"dashboard:80"}]}],"match":[{"path":["/*"]}]}]}],"terminal":true}],"tls_connection_policies":[{}],"automatic_https":{}},"srv1":{"listen":[":80"],"routes":[{},{"handle":[{"handler":"headers","response":{"deferred":true,"delete":["Server"],"set":{"Referrer-Policy":["strict-origin-when-cross-origin"],"Strict-Transport-Security":["max-age=3600; includeSubDomains; preload"],"X-Content-Type-Options":["nosniff"],"X-Frame-Options":["DENY"],"X-Xss-Protection":["1; mode=block"]}}}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"signal:10000"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"management:80"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"management:80"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"dashboard:80"}]}]},{}],"automatic_https":{"disable":true}}}}}
caddy-1 | {"level":"info","ts":1725657154.4226544,"logger":"http","msg":"enabling HTTP/3 listener","addr":":443"}
caddy-1 | {"level":"info","ts":1725657154.4227445,"msg":"failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 7168 kiB, got: 416 kiB). See https://github.com/quic-go/quic-go/wiki/UDP-Buffer-Sizes for details."}
caddy-1 | {"level":"debug","ts":1725657154.4228404,"logger":"http","msg":"starting server loop","address":"[::]:443","tls":true,"http3":true}
caddy-1 | {"level":"info","ts":1725657154.4229102,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]}
caddy-1 | {"level":"debug","ts":1725657154.4229472,"logger":"http","msg":"starting server loop","address":"[::]:80","tls":false,"http3":false}
caddy-1 | {"level":"info","ts":1725657154.4229507,"logger":"http.log","msg":"server running","name":"srv1","protocols":["h1","h2","h3"]}
caddy-1 | {"level":"info","ts":1725657154.422953,"logger":"http","msg":"enabling automatic TLS certificate management","domains":["netbird.grayhatlabs.com"]}
caddy-1 | {"level":"info","ts":1725657154.4233918,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"}
caddy-1 | {"level":"info","ts":1725657154.4233959,"msg":"serving initial configuration"}
caddy-1 | {"level":"info","ts":1725657154.423417,"logger":"tls.obtain","msg":"acquiring lock","identifier":"netbird.grayhatlabs.com"}
caddy-1 | {"level":"info","ts":1725657154.4263494,"logger":"tls","msg":"cleaning storage unit","storage":"FileStorage:/data/caddy"}
caddy-1 | {"level":"info","ts":1725657154.4264882,"logger":"tls","msg":"finished cleaning storage units"}
caddy-1 | {"level":"info","ts":1725657154.4300373,"logger":"tls.obtain","msg":"lock acquired","identifier":"netbird.grayhatlabs.com"}
caddy-1 | {"level":"info","ts":1725657154.4300869,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"netbird.grayhatlabs.com"}
caddy-1 | {"level":"debug","ts":1725657154.4301236,"logger":"events","msg":"event","name":"cert_obtaining","id":"65e2b213-f969-4b13-aef5-61fcf8817c43","origin":"tls","data":{"identifier":"netbird.grayhatlabs.com"}}
caddy-1 | {"level":"debug","ts":1725657154.4302905,"logger":"tls.obtain","msg":"trying issuer 1/1","issuer":"acme-v02.api.letsencrypt.org-directory"}
caddy-1 | {"level":"debug","ts":1725657154.4846947,"logger":"http.acme_client","msg":"http request","method":"GET","url":"https://acme-v02.api.letsencrypt.org/directory","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["746"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:34 GMT"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657154.5071867,"logger":"http.acme_client","msg":"http request","method":"HEAD","url":"https://acme-v02.api.letsencrypt.org/acme/new-nonce","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Date":["Fri, 06 Sep 2024 21:12:34 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["4OmWUlyUY-_HPprN59_xVlKJkt9O-YY_WTIxBaZsfyq8B33lRxk"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657154.7627168,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/new-acct","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["268"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:34 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\"","https://letsencrypt.org/documents/LE-SA-v1.4-April-3-2024.pdf;rel=\"terms-of-service\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/acct/1932803736"],"Replay-Nonce":["4OmWUlyUwLQvUn6DbpQlR0ooygqKnDg3g7k-49SNWv71jvx5sWQ"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201}
caddy-1 | {"level":"info","ts":1725657154.763,"logger":"http","msg":"waiting on internal rate limiter","identifiers":["netbird.grayhatlabs.com"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":""}
caddy-1 | {"level":"info","ts":1725657154.7630105,"logger":"http","msg":"done waiting on internal rate limiter","identifiers":["netbird.grayhatlabs.com"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":""}
caddy-1 | {"level":"info","ts":1725657154.7630312,"logger":"http","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/1932803736","account_contact":[]}
caddy-1 | {"level":"debug","ts":1725657154.7630374,"logger":"http.acme_client","msg":"creating order","account":"https://acme-v02.api.letsencrypt.org/acme/acct/1932803736","identifiers":["netbird.grayhatlabs.com"]}
caddy-1 | {"level":"debug","ts":1725657155.0481026,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["349"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899632366"],"Replay-Nonce":["fCBw7MtQDPtAu8H7R6pUGWKlPokogCJg8vQLFMrPOTxYlardubU"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201}
caddy-1 | {"level":"debug","ts":1725657155.0809524,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249459646","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["807"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["4OmWUlyUdqOAI1vcVFsJJOOZR76TlWmmCH-Eq-1_8CkjYvkPMBU"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657155.0810509,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"}
caddy-1 | {"level":"info","ts":1725657155.0810542,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}
caddy-1 | {"level":"debug","ts":1725657155.081257,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"}
caddy-1 | {"level":"debug","ts":1725657155.081264,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"}
caddy-1 | {"level":"debug","ts":1725657155.134401,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249459646/Z2YT1w","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["187"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249459646;rel=\"up\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249459646/Z2YT1w"],"Replay-Nonce":["fCBw7MtQXprOm8Tes9OgN9ubIALvfQSuVKlGQTXrFn3xJuya5F8"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657155.1344252,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"}
caddy-1 | {"level":"debug","ts":1725657155.4128547,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249459646","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["768"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["4OmWUlyUwpqIxrsigb0eA-Ru_RCfE7-_Cb3Z9uWdzvhkQkRwys0"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"error","ts":1725657155.4129443,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}}
caddy-1 | {"level":"error","ts":1725657155.4129596,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899632366","attempt":1,"max_attempts":3}
caddy-1 | {"level":"debug","ts":1725657156.4130719,"logger":"http.acme_client","msg":"creating order","account":"https://acme-v02.api.letsencrypt.org/acme/acct/1932803736","identifiers":["netbird.grayhatlabs.com"]}
caddy-1 | {"level":"debug","ts":1725657156.7512052,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["349"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:36 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899638096"],"Replay-Nonce":["4OmWUlyUwrd-OjgVIoSvq08ri-qMP_DizBbRUvjffajKeL4R4_c"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201}
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="initialization started" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/init.go:75"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify user" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_user.go:39" username=zitadel
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify database" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_database.go:39" database=zitadel
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify grant" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_grant.go:34" database=zitadel user=zitadel
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify zitadel" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:78" database=zitadel
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify system" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:39"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify encryption keys" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:44"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify projections" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:49"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify eventstore" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:54"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify events tables" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:59"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify system sequence" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:64"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify unique constraints" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:69"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="setup started" caller="/home/runner/work/zitadel/zitadel/cmd/setup/setup.go:99"
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=14_events_push
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=14_events_push
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=01_tables
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=01_tables
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=02_assets
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=02_assets
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=03_default_instance
zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=03_default_instance
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=05_last_failed
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=05_last_failed
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=06_resource_owner_columns
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=06_resource_owner_columns
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=07_logstore
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=07_logstore
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=08_auth_token_indexes
zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=08_auth_token_indexes
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=12_auth_users_otp_columns
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=12_auth_users_otp_columns
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=13_fix_quota_constraints
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=13_fix_quota_constraints
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=01_new_failed_events.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=02_fe_from_projections.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=03_fe_from_adminapi.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=04_fe_from_auth.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=05_current_states.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=06_cs_from_projections.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=07_cs_from_adminapi.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=08_cs_from_auth.sql migration=15_current_projection_state
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=16_unique_constraint_lower
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=16_unique_constraint_lower
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="unique constraints updated" caller="/home/runner/work/zitadel/zitadel/cmd/setup/16.go:28" count=0
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=17_add_offset_col_to_current_states
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=17_add_offset_col_to_current_states
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=19_add_current_sequences_index
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=19_add_current_sequences_index
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=20_add_by_user_index_on_session
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=20_add_by_user_index_on_session
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=22_active_instance_events_index
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=22_active_instance_events_index
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=23_correct_global_unique_constraints
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=23_correct_global_unique_constraints
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=24_add_actor_col_to_auth_tokens
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=24_add_actor_col_to_auth_tokens
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=26_auth_users3
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=26_auth_users3
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=config_change
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=config_change
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projection_tables
zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projection_tables
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.orgs1
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.orgs1
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.actions3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.actions3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.projects4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.projects4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.domain_policies2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.domain_policies2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.label_policies3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.label_policies3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_roles4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_roles4
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.org_domains2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.org_domains2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.login_policies5
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.login_policies5
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idps3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idps3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.apps7
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.apps7
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idp_user_links3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idp_user_links3
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.message_texts2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.message_texts2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.users12
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.users12
zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.login_names3
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.login_names3
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.org_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.org_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instance_domains
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instance_domains
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_grant_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_grant_members4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_grants5
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_grants5
caddy-1 | {"level":"debug","ts":1725657156.7786167,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249467916","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["807"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:36 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["fCBw7MtQi7UyIcMIqz0iiBOV8V6iGrP60ApzpE9CDLMxRJI5Cnw"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657156.7786863,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"}
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_metadata5
caddy-1 | {"level":"info","ts":1725657156.778689,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}
caddy-1 | {"level":"debug","ts":1725657156.7790434,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"}
caddy-1 | {"level":"debug","ts":1725657156.7790515,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"}
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_metadata5
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instances
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instances
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.notification_providers
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.notification_providers
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.keys4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.keys4
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.security_policies2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.security_policies2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.notification_policies
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.notification_policies
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.device_auth_requests2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.device_auth_requests2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.sessions8
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.sessions8
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.auth_requests
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.auth_requests
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.milestones
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.milestones
caddy-1 | {"level":"debug","ts":1725657156.7790928,"logger":"http.stdlib","msg":"http: TLS handshake error from 127.0.0.1:48400: EOF"}
caddy-1 | {"level":"debug","ts":1725657156.8206215,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249467916/BRcRyw","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["191"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:36 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249467916;rel=\"up\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249467916/BRcRyw"],"Replay-Nonce":["fCBw7MtQ9Ygxg4uN37AK5MBVJMl-SaA_CyZYD8wHRVefm1fFcMI"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.quotas
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.quotas
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.limits
caddy-1 | {"level":"debug","ts":1725657156.820654,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"}
caddy-1 | {"level":"debug","ts":1725657157.1112025,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249467916","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["902"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:37 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["fCBw7MtQcBPZua5Dfq7YZYjCllqQKwh-aHONogI81bCNRMZRNHk"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"error","ts":1725657157.1113408,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}}
caddy-1 | {"level":"error","ts":1725657157.1113503,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899638096","attempt":2,"max_attempts":3}
caddy-1 | {"level":"error","ts":1725657157.111365,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"netbird.grayhatlabs.com","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain"}
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.limits
caddy-1 | {"level":"debug","ts":1725657157.1113937,"logger":"events","msg":"event","name":"cert_failed","id":"66018c11-28e4-40fb-a42e-69a947134e2c","origin":"tls","data":{"error":{},"identifier":"netbird.grayhatlabs.com","issuers":["acme-v02.api.letsencrypt.org-directory"],"renewal":false}}
caddy-1 | {"level":"error","ts":1725657157.1113992,"logger":"tls.obtain","msg":"will retry","error":"[netbird.grayhatlabs.com] Obtain: [netbird.grayhatlabs.com] solving challenge: netbird.grayhatlabs.com: [netbird.grayhatlabs.com] authorization failed: HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain (ca=https://acme-v02.api.letsencrypt.org/directory)","attempt":1,"retrying_in":60,"elapsed":2.681355266,"max_duration":2592000}
caddy-1 | {"level":"info","ts":1725657217.1140587,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"netbird.grayhatlabs.com"}
caddy-1 | {"level":"debug","ts":1725657217.1140976,"logger":"events","msg":"event","name":"cert_obtaining","id":"f5449649-6718-4eea-ad36-6f018c052321","origin":"tls","data":{"identifier":"netbird.grayhatlabs.com"}}
caddy-1 | {"level":"debug","ts":1725657217.1142256,"logger":"tls.obtain","msg":"trying issuer 1/1","issuer":"acme-v02.api.letsencrypt.org-directory"}
caddy-1 | {"level":"debug","ts":1725657217.1371498,"logger":"http.acme_client","msg":"http request","method":"GET","url":"https://acme-staging-v02.api.letsencrypt.org/directory","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["820"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657217.143803,"logger":"http.acme_client","msg":"http request","method":"HEAD","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-nonce","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["6wrlOJ0TkPrI895NSM_0fkf1NCftBdNqcyn-8hpwrypdkkztu98"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657217.1727147,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-acct","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["267"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\"","https://letsencrypt.org/documents/LE-SA-v1.4-April-3-2024.pdf;rel=\"terms-of-service\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523"],"Replay-Nonce":["6wrlOJ0T0SFSuQdnAPaarI03njcxYJyU73a9nadZ-k7ulTPAFmw"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201}
caddy-1 | {"level":"info","ts":1725657217.1728928,"logger":"http","msg":"using ACME account","account_id":"https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523","account_contact":[]}
caddy-1 | {"level":"debug","ts":1725657217.172899,"logger":"http.acme_client","msg":"creating order","account":"https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523","identifiers":["netbird.grayhatlabs.com"]}
caddy-1 | {"level":"debug","ts":1725657217.2257783,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["362"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272733"],"Replay-Nonce":["6wrlOJ0TKGJ8O5zVkbrU5Y-o458FhTIuCdof4pzUWCTV07XGQFo"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201}
caddy-1 | {"level":"debug","ts":1725657217.2413557,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760363","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["828"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["_yLDrU7Hoy2f2fCYy-Wk89F1NPdTApV-RPCOu1SfCebO1XG4vYY"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657217.24139,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"}
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.restrictions2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.restrictions2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.system_features
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.system_features
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instance_features2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instance_features2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.targets1
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.targets1
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.executions1
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.executions1
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_schemas
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_schemas
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=18_add_lower_fields_to_login_names
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=18_add_lower_fields_to_login_names
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=21_add_block_field_to_limits
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=21_add_block_field_to_limits
caddy-1 | {"level":"info","ts":1725657217.2413924,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","ca":"https://acme-staging-v02.api.letsencrypt.org/directory"}
caddy-1 | {"level":"debug","ts":1725657217.2416775,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"}
caddy-1 | {"level":"debug","ts":1725657217.2416816,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"}
caddy-1 | {"level":"debug","ts":1725657217.2417145,"logger":"http.stdlib","msg":"http: TLS handshake error from 127.0.0.1:59718: EOF"}
caddy-1 | {"level":"debug","ts":1725657217.2581222,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760363/CfxIlQ","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["198"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760363;rel=\"up\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760363/CfxIlQ"],"Replay-Nonce":["_yLDrU7H0fDr7xI045d973XIJ1yMNCT2EDzPbutqLFKPL4gkCa0"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657217.2581508,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"}
caddy-1 | {"level":"debug","ts":1725657217.5190697,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760363","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["909"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["6wrlOJ0Ty5I7o3VLq5Mu8hhbNTu7klqU4uC99dRNqXjYBDx1Jcg"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"error","ts":1725657217.5191562,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}}
caddy-1 | {"level":"error","ts":1725657217.5191665,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272733","attempt":1,"max_attempts":3}
caddy-1 | {"level":"debug","ts":1725657218.5196052,"logger":"http.acme_client","msg":"creating order","account":"https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523","identifiers":["netbird.grayhatlabs.com"]}
caddy-1 | {"level":"debug","ts":1725657218.5664308,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["362"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272983"],"Replay-Nonce":["_yLDrU7HSXr-OTuVbDfBKhlKjoqL_jRm5CALq1-OVri0ZiZWRwU"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201}
caddy-1 | {"level":"debug","ts":1725657218.5791101,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760473","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["828"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["_yLDrU7HO8f6m7XDnMPU_xvpP5py2PHcJm-96fYAwEVMvMETHAc"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657218.579155,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"}
caddy-1 | {"level":"info","ts":1725657218.5791583,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","ca":"https://acme-staging-v02.api.letsencrypt.org/directory"}
caddy-1 | {"level":"debug","ts":1725657218.5793295,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"}
caddy-1 | {"level":"debug","ts":1725657218.5793333,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"}
caddy-1 | {"level":"debug","ts":1725657218.5926228,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760473/N8xjqw","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["194"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760473;rel=\"up\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760473/N8xjqw"],"Replay-Nonce":["6wrlOJ0TKE8z9X7zA5CeB0E_DhADp9tJxoeaUndwp_q3VKEwLbc"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"debug","ts":1725657218.592643,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"}
caddy-1 | {"level":"debug","ts":1725657218.8550355,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760473","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["775"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["6wrlOJ0TGjDtnClqYQGncu1b7uDmlidMgHSv6Hp1f8I3gp-8Quc"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200}
caddy-1 | {"level":"error","ts":1725657218.8551793,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}}
caddy-1 | {"level":"error","ts":1725657218.8551881,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272983","attempt":2,"max_attempts":3}
caddy-1 | {"level":"error","ts":1725657218.8551986,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"netbird.grayhatlabs.com","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain"}
caddy-1 | {"level":"debug","ts":1725657218.8552127,"logger":"events","msg":"event","name":"cert_failed","id":"c602a85e-8437-40eb-ae0b-3cd0a45db7c8","origin":"tls","data":{"error":{},"identifier":"netbird.grayhatlabs.com","issuers":["acme-v02.api.letsencrypt.org-directory"],"renewal":false}}
caddy-1 | {"level":"error","ts":1725657218.8552167,"logger":"tls.obtain","msg":"will retry","error":"[netbird.grayhatlabs.com] Obtain: [netbird.grayhatlabs.com] solving challenge: netbird.grayhatlabs.com: [netbird.grayhatlabs.com] authorization failed: HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain (ca=https://acme-staging-v02.api.letsencrypt.org/directory)","attempt":2,"retrying_in":120,"elapsed":64.425172808,"max_duration":2592000}
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=25_user12_add_lower_fields_to_verified_email
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=25_user12_add_lower_fields_to_verified_email
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=26_idp_templates6_add_saml_name_id_format
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=26_idp_templates6_add_saml_name_id_format
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="init-projections is currently in beta" caller="/home/runner/work/zitadel/zitadel/cmd/setup/setup.go:245"
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.orgs1
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.orgs1
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.orgs1
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.orgs1
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.orgs1 took=120.622055ms
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.org_metadata2 took=114.449459ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.actions3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.actions3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.actions3
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.actions3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.actions3 took=115.912465ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.flow_triggers3 took=114.572138ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.projects4
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.projects4
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.projects4
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.projects4
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.projects4 took=114.953609ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.password_complexity_policies2 took=145.808795ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.password_age_policies2 took=115.165697ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.lockout_policies3 took=114.947168ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.privacy_policies4 took=115.079257ms
zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.domain_policies2
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.domain_policies2
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.domain_policies2
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.domain_policies2
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.domain_policies2 took=114.767657ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.label_policies3
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.label_policies3
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.label_policies3
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.label_policies3
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.label_policies3 took=116.259232ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_grants4 took=114.717205ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_roles4
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_roles4
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_roles4
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_roles4
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_roles4 took=114.541318ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.org_domains2
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.org_domains2
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.org_domains2
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_domains2
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.org_domains2 took=115.813221ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.login_policies5
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.login_policies5
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.login_policies5
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_policies5
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.login_policies5 took=116.00462ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idps3
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idps3
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idps3
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idps3
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idps3 took=115.027995ms
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idp_templates6 took=115.379603ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.apps7
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.apps7
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.apps7
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.apps7
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.apps7 took=117.878048ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idp_user_links3
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idp_user_links3
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idp_user_links3
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_user_links3
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idp_user_links3 took=114.674204ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idp_login_policy_links5 took=114.497805ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.mail_templates2 took=115.843677ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.message_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.message_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.message_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.message_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.message_texts2 took=122.246376ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.custom_texts2 took=121.512841ms
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.users12
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.users12
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.users12
zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.users12
zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.users12 took=117.107306ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.login_names3
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.login_names3
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.login_names3
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_names3
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.login_names3 took=116.576043ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.org_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.org_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.org_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.org_members4 took=128.59637ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instance_domains
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instance_domains
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instance_domains
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_domains
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instance_domains took=115.623607ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instance_members4 took=126.540324ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_members4 took=120.505342ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_grant_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_grant_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_grant_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_grant_members4
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_grant_members4 took=114.451749ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.authn_keys2 took=114.859292ms
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.personal_access_tokens3 took=115.605368ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_grants5
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_grants5
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_grants5
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_grants5
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_grants5 took=114.804869ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_metadata5
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_metadata5
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_metadata5
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_metadata5
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_metadata5 took=114.544904ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_auth_methods4 took=114.688767ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instances
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instances
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instances
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instances
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instances took=116.261317ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.secret_generators2 took=116.664226ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.smtp_configs2 took=114.642846ms
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.sms_configs2 took=114.726589ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.oidc_settings2 took=114.699615ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notification_providers
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notification_providers
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notification_providers
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_providers
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notification_providers took=114.823078ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.keys4
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.keys4
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.keys4
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.keys4
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.keys4 took=114.56818ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.security_policies2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.security_policies2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.security_policies2
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.security_policies2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.security_policies2 took=114.447392ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notification_policies
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notification_policies
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notification_policies
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_policies
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notification_policies took=114.865154ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.device_auth_requests2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.device_auth_requests2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.device_auth_requests2
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.device_auth_requests2
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.device_auth_requests2 took=114.522899ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.sessions8
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.sessions8
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.sessions8
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sessions8
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.sessions8 took=114.585779ms
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.auth_requests
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.auth_requests
zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.auth_requests
zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.auth_requests
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.auth_requests took=114.536266ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.milestones
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.milestones
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.milestones
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.milestones
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.milestones took=116.435663ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.quotas
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.quotas
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.quotas
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.quotas
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.quotas took=114.519761ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.limits
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.limits
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.limits
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.limits
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.limits took=114.649282ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.restrictions2
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.restrictions2
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.restrictions2
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.restrictions2
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.restrictions2 took=114.457616ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.system_features
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.system_features
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.system_features
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.system_features
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.system_features took=114.633516ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instance_features2
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instance_features2
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instance_features2
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_features2
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instance_features2 took=114.932121ms
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.targets1
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.targets1
zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.targets1
zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.targets1
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.targets1 took=114.725968ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.executions1
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.executions1
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.executions1
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.executions1
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.executions1 took=114.701679ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_schemas
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_schemas
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_schemas
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_schemas
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_schemas took=114.733491ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=adminapi.styling2
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=adminapi.styling2
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=adminapi.styling2
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=adminapi.styling2
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=adminapi.styling2 took=46.113489ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.users3
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.users3
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.users3
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.users3
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.users3 took=14.811601ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.user_sessions
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.user_sessions
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.user_sessions
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.user_sessions
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.user_sessions took=14.851686ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.tokens took=17.305914ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.refresh_tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.refresh_tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.refresh_tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.refresh_tokens
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.refresh_tokens took=14.310929ms
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notifications
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notifications
zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notifications
zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications
zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notifications took=1.017515356s
zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notifications_quota
zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notifications_quota
zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notifications_quota
zitadel-1 | time="2024-09-06T21:12:52Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications_quota
zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notificationsquota took=1.014346924s
zitadel-1 | ____ _ ___ _
zitadel-1 | | / | | | | / \ | \ | ____| | |
zitadel-1 | / / | | | | / \ | | | | | | | |
zitadel-1 | / / | | | | / _ \ | || | | | | |_
zitadel-1 | /| |__| || // \\ |/ || ||
zitadel-1 |
zitadel-1 | ===============================================================
zitadel-1 |
zitadel-1 | Version : v2.54.3
zitadel-1 | TLS enabled : false
zitadel-1 | External Secure : true
zitadel-1 | Console URL : https://netbird.grayhatlabs.com:443/ui/console
zitadel-1 | Health Check URL : https://netbird.grayhatlabs.com:443/debug/healthz
zitadel-1 |
zitadel-1 | ===============================================================
zitadel-1 |
zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="auth request cache disabled" caller="/home/runner/work/zitadel/zitadel/internal/auth_request/repository/cache/cache.go:31" error="must provide a positive size"
zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="auth request cache disabled" caller="/home/runner/work/zitadel/zitadel/internal/auth_request/repository/cache/cache.go:36" error="must provide a positive size"
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/authorize
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/device_authorization
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/token
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/introspect
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oidc/v1/userinfo
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/revoke
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oidc/v1/end_session
zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/keys
zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="server is listening on [::]:8080" caller="/home/runner/work/zitadel/zitadel/cmd/start/start.go:514"
zitadel-1 | time="2024-09-06T21:12:55Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_grants4
zitadel-1 | time="2024-09-06T21:12:56Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.actions3
zitadel-1 | time="2024-09-06T21:12:56Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.smtp_configs2
zitadel-1 | time="2024-09-06T21:12:57Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_members4
zitadel-1 | time="2024-09-06T21:12:59Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.orgs1
zitadel-1 | time="2024-09-06T21:13:00Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_members4
zitadel-1 | time="2024-09-06T21:13:00Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_names3
zitadel-1 | time="2024-09-06T21:13:00Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.apps7
zitadel-1 | time="2024-09-06T21:13:01Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_roles4
zitadel-1 | time="2024-09-06T21:13:03Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_metadata5
zitadel-1 | time="2024-09-06T21:13:05Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.system_features
zitadel-1 | time="2024-09-06T21:13:07Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.authn_keys2
zitadel-1 | time="2024-09-06T21:13:08Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_members4
zitadel-1 | time="2024-09-06T21:13:08Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.projects4
zitadel-1 | time="2024-09-06T21:13:09Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.oidc_settings2
zitadel-1 | time="2024-09-06T21:13:09Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.quotas
zitadel-1 | time="2024-09-06T21:13:10Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.flow_triggers3
zitadel-1 | time="2024-09-06T21:13:11Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_auth_methods4
zitadel-1 | time="2024-09-06T21:13:13Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.tokens
zitadel-1 | time="2024-09-06T21:13:13Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.message_texts2
zitadel-1 | time="2024-09-06T21:13:15Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications
zitadel-1 | time="2024-09-06T21:13:17Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_policies
zitadel-1 | time="2024-09-06T21:13:19Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_complexity_policies2
zitadel-1 | time="2024-09-06T21:13:19Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.keys4
zitadel-1 | time="2024-09-06T21:13:20Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_metadata2
zitadel-1 | time="2024-09-06T21:13:21Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.executions1
zitadel-1 | time="2024-09-06T21:13:23Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.lockout_policies3
zitadel-1 | time="2024-09-06T21:13:24Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_age_policies2
zitadel-1 | time="2024-09-06T21:13:28Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.auth_requests
zitadel-1 | time="2024-09-06T21:13:29Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.security_policies2
zitadel-1 | time="2024-09-06T21:13:31Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.milestones
zitadel-1 | time="2024-09-06T21:13:31Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_templates6
zitadel-1 | time="2024-09-06T21:13:33Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_features2
zitadel-1 | time="2024-09-06T21:13:33Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_login_policy_links5
zitadel-1 | time="2024-09-06T21:13:34Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.label_policies3
zitadel-1 | time="2024-09-06T21:13:35Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_grants5
zitadel-1 | time="2024-09-06T21:13:35Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.secret_generators2
zitadel-1 | time="2024-09-06T21:13:36Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instances
zitadel-1 | time="2024-09-06T21:13:36Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.targets1
zitadel-1 | time="2024-09-06T21:13:37Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_domains2
zitadel-1 | time="2024-09-06T21:13:38Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sessions8
zitadel-1 | time="2024-09-06T21:13:39Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sms_configs2
zitadel-1 | time="2024-09-06T21:13:39Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=adminapi.styling2
zitadel-1 | time="2024-09-06T21:13:39Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.mail_templates2
zitadel-1 | time="2024-09-06T21:13:40Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_providers
zitadel-1 | time="2024-09-06T21:13:41Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.personal_access_tokens3
zitadel-1 | time="2024-09-06T21:13:41Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.custom_texts2
zitadel-1 | time="2024-09-06T21:13:42Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_domains
zitadel-1 | time="2024-09-06T21:13:42Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.limits
zitadel-1 | time="2024-09-06T21:13:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_policies5
zitadel-1 | time="2024-09-06T21:13:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.privacy_policies4
zitadel-1 | time="2024-09-06T21:13:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_schemas
zitadel-1 | time="2024-09-06T21:13:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.tokens
zitadel-1 | time="2024-09-06T21:13:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications
Hi All,
I've been using Netmaker and Tailscale (headscale) successfully but came across Netbird and keen to give it a go.
I am following the selfhosted-quickstart guide: https://docs.netbird.io/selfhosted/selfhosted-quickstart on a fresh VPS (Oracle Ubuntu 22.04).
I've installed docker and validate that it is working. When I run the script, it get:
Rendering initial files...
Initializing Zitadel's CockroachDB
[+] Running 7/7 ✔ Network ubuntu_netbird Created 0.1s ✔ Volume "ubuntu_netbird_caddy_data" Created 0.0s ✔ Volume "ubuntu_netbird_management" Created 0.0s ✔ Volume "ubuntu_netbird_zitadel_certs" Created 0.0s ✔ Volume "ubuntu_netbird_crdb_data" Created 0.0s ✔ Volume "ubuntu_netbird_crdb_certs" Created 0.0s ✔ Container ubuntu-crdb-1 Started 0.0s
Waiting cockroachDB to become ready . done
Starting Zidatel IDP for user management
[+] Running 3/3 ✔ Container ubuntu-crdb-1 Healthy 0.0s ✔ Container ubuntu-zitadel-1 Started 0.0s ✔ Container ubuntu-caddy-1 Started 0.0s
Initializing Zitadel with NetBird's applications
Waiting for Zitadel's PAT to be created . . . done Reading Zitadel PAT Waiting for Zitadel to become ready . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
and then it just sits there indefinitely without any errors. I have tried to go into the logs of the running containers but I can't see any glaring issues.
If I re-run the script it first wants me to dump the docker containers and clear the directory where the config files are stored. I do that, re-run and end up in the same loop.
I have searched for similar issues reported but can't find a solution by another user - only an unanswered slack post.
Any ideas on how to get passed this would be great.