netbirdio / netbird

Connect your devices into a secure WireGuard®-based overlay network with SSO, MFA and granular access controls.
https://netbird.io
BSD 3-Clause "New" or "Revised" License
11.29k stars 518 forks source link

selfhosted-quickstart - Waiting for Zitadel loop #1247

Open Dyad-ITSS opened 1 year ago

Dyad-ITSS commented 1 year ago

Hi All,

I've been using Netmaker and Tailscale (headscale) successfully but came across Netbird and keen to give it a go.

I am following the selfhosted-quickstart guide: https://docs.netbird.io/selfhosted/selfhosted-quickstart on a fresh VPS (Oracle Ubuntu 22.04).

I've installed docker and validate that it is working. When I run the script, it get:

Rendering initial files...

Initializing Zitadel's CockroachDB

[+] Running 7/7 ✔ Network ubuntu_netbird Created 0.1s ✔ Volume "ubuntu_netbird_caddy_data" Created 0.0s ✔ Volume "ubuntu_netbird_management" Created 0.0s ✔ Volume "ubuntu_netbird_zitadel_certs" Created 0.0s ✔ Volume "ubuntu_netbird_crdb_data" Created 0.0s ✔ Volume "ubuntu_netbird_crdb_certs" Created 0.0s ✔ Container ubuntu-crdb-1 Started 0.0s

Waiting cockroachDB to become ready . done

Starting Zidatel IDP for user management

[+] Running 3/3 ✔ Container ubuntu-crdb-1 Healthy 0.0s ✔ Container ubuntu-zitadel-1 Started 0.0s ✔ Container ubuntu-caddy-1 Started 0.0s

Initializing Zitadel with NetBird's applications

Waiting for Zitadel's PAT to be created . . . done Reading Zitadel PAT Waiting for Zitadel to become ready . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

and then it just sits there indefinitely without any errors. I have tried to go into the logs of the running containers but I can't see any glaring issues.

If I re-run the script it first wants me to dump the docker containers and clear the directory where the config files are stored. I do that, re-run and end up in the same loop.

I have searched for similar issues reported but can't find a solution by another user - only an unanswered slack post.

Any ideas on how to get passed this would be great.

mlsmaycon commented 1 year ago

Hello @Dyad-ITSS can you check the Caddy server logs? This loop might be a sign of issues with the certificate generation by caddy.

If this is the case, please check the domain configuration and that it is pointing to the right VM IP and that the following ports are open:

TCP ports 80 and 443 and UDP ports: 3478, 49152-65535.

Dyad-ITSS commented 1 year ago

That was it - thanks. Somehow Caddy was looking at the wrong domain. Even though I specified the correct domain in the script process.

Dumped the VPS, started fresh and it's up.

Thanks.

duanyunlun commented 12 months ago

Hello @Dyad-ITSS can you check the Caddy server logs? This loop might be a sign of issues with the certificate generation by caddy.

If this is the case, please check the domain configuration and that it is pointing to the right VM IP and that the following ports are open:

TCP ports 80 and 443 and UDP ports: 3478, 49152-65535.

Hello @mlsmaycon I've try open the ports mentioned above but still lead to the "Waiting for Zitadel loop". Try different VPS and still the same. Could be any reason?

mlsmaycon commented 12 months ago

@duanyunlun do you have any logs about the certificates in caddy?

Can you share the logs from Zitadel and Caddy?

duanyunlun commented 12 months ago

@duanyunlun do you have any logs about the certificates in caddy?

Can you share the logs from Zitadel and Caddy?

Sorry for the logs lost, how can I take the logs from docker? where is the files' location?

duanyunlun commented 12 months ago

caddy.log

zitadel.log

@mlsmaycon Here's the logs of caddy and zitadel.

mlsmaycon commented 12 months ago

You can run:

docker compose logs caddy > caddy.log 2>&1
docker compose logs zitadel > zitadel.log 2>&1
mlsmaycon commented 12 months ago

Hello @duanyunlun the error seems to be related to firewall, the following request is failing:

Fetching http://net.liekong1991.cn/.well-known/acme-challenge/m1rLBDKI2mT_CjJJxy7B4nOWp-ZcdcO9FJGYqyziFkI: Connection refused

log even:

{"level":"error","ts":1701254942.4022658,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"net.liekong1991.cn","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:connection - 103.153.139.60: **Fetching http://net.liekong1991.cn/.well-known/acme-challenge/m1rLBDKI2mT_CjJJxy7B4nOWp-ZcdcO9FJGYqyziFkI: Connection refused**"}

Can you make sure that port 80 is open?

duanyunlun commented 12 months ago

Hi, @mlsmaycon I've already open all the ports on the VPS firewall.

duanyunlun commented 12 months ago

Here's the firewall setting, all needed ports are set to both TCP AND UDP with IN AND OUT.

image image
mlsmaycon commented 12 months ago

I cannot reach these ports. Can you confirm that they are accessible?

image

It could be filtered in another layer, perhaps a local system firewall like firewalld

duanyunlun commented 12 months ago

I can't confirm what firewall could be there 'cause the VPS has been reset many times. The system is Ubuntu22.04 LTS and I didn't install any software unless the required softs of netbird self-hosted deployment.

duanyunlun commented 12 months ago

What is very strange is that after I changed VPS from several cloud service providers, I finally found one that worked. The firewall settings between them are exactly the same

BlackBatM4n commented 11 months ago

hi, i got the same problem trying to selfhost in my local network,

this is my caddy log:

{"level":"debug","ts":1702034098.8644276,"logger":"tls.handshake","msg":"no matching certificates and no custom selection logic","identifier":"172.18.0.3"} {"level":"debug","ts":1702034098.8644433,"logger":"tls.handshake","msg":"no certificate matching TLS ClientHello","remote_ip":"172.16.21.221","remote_port":"43018","server_name":"","remote":"172.16.21.221:43018","identifier":"172.18.0.3","cipher_suites":[4866,4867,4865,49196,49200,159,52393,52392,52394,49195,49199,158,49188,49192,107,49187,49191,103,49162,49172,57,49161,49171,51,157,156,61,60,53,47,255],"cert_cache_fill":0.0001,"load_or_obtain_if_necessary":true,"on_demand":false} {"level":"debug","ts":1702034098.864522,"logger":"http.stdlib","msg":"http: TLS handshake error from 172.16.21.221:43018: no certificate available for '172.18.0.3'"}

maybe i dont know but can i run netbird with my local ip ? i just want to test the server locally first, thanks

duanyunlun commented 11 months ago

@BlackBatM4n I don't think you can setup it on local network

gedw99 commented 9 months ago

You can run netbird locally on Linux, Mac and windows with caddy and local domains fully utilising HTTPS using this.

export NETBIRD_DOMAIN=netbird.local

HOST_PROFILE=netbird
HOSTS_FILE=$(PWD)/.etchosts

### setup hosts file so caddy works woth local URLS and HTTPS 

host-init:
        # install hostsctl
        go install github.com/guumaster/hostctl/cmd/hostctl@latest

    # create the ./etchosts
    @echo $(NETBIRD_DOMAIN)
    rm -rf $(HOSTS_FILE)
    @echo "127.0.0.1 $(NETBIRD_DOMAIN)" >> $(HOSTS_FILE)
host-run:
    # https://guumaster.github.io/hostctl/docs/guides/basic_profiles/
    sudo hostctl replace $(HOST_PROFILE) --from $(HOSTS_FILE)
host-run-del:
    sudo hostctl remove $(HOST_PROFILE)
    hostctl list
host-ls:
    hostctl list
jt0321 commented 7 months ago

You can run netbird locally on Linux, Mac and windows with caddy and local domains fully utilising HTTPS using this.

export NETBIRD_DOMAIN=netbird.local

HOST_PROFILE=netbird
HOSTS_FILE=$(PWD)/.etchosts

### setup hosts file so caddy works woth local URLS and HTTPS 

host-init:
        # install hostsctl
        go install github.com/guumaster/hostctl/cmd/hostctl@latest

  # create the ./etchosts
  @echo $(NETBIRD_DOMAIN)
  rm -rf $(HOSTS_FILE)
  @echo "127.0.0.1 $(NETBIRD_DOMAIN)" >> $(HOSTS_FILE)
host-run:
  # https://guumaster.github.io/hostctl/docs/guides/basic_profiles/
  sudo hostctl replace $(HOST_PROFILE) --from $(HOSTS_FILE)
host-run-del:
  sudo hostctl remove $(HOST_PROFILE)
  hostctl list
host-ls:
  hostctl list

how would I integrate this with the quickstart script or advanced self-hosted scripts from infrastructure_files? by editing an existing script, .env file, docker / whatever yml file, or by adding a new file (script/env/yml) ..?

itsmejomijohn commented 2 months ago

@Dyad-ITSS are you able to solve the issue, i have the same issue, i am stuck with Zitadel to become ready LOOP, what to do

sajaljainsyd commented 2 months ago

@itsmejomijohn , try installing an older version, it helped me to solve the issue.

mlsmaycon commented 2 months ago

@Dyad-ITSS, when the script is stuck in this loop, it usually means that there is a problem with the certificate; you can have a look at the caddy logs to find out more. If there is nothing there, please share all logs from:

docker compose logs

Nedbup commented 2 months ago

I am having the same issue

[ingo@Docker02 docker]$ export NETBIRD_DOMAIN=netbird.grayhatlabs.com; curl -fsSL https://github.com/netbirdio/netbird/releases/latest/download/getting-started-with-zitadel.sh | bash Use Postgres as default Zitadel database. For using CockroachDB please the environment variable 'export ZITADEL_DATABASE=cockroach'. Rendering initial files...

Starting Zitadel IDP for user management

WARN[0000] /home/ingo/docker/docker-compose.yml: the attribute version is obsolete, it will be ignored, please remove it to avoid potential confusion [+] Running 7/7 ✔ Network docker_netbird Created 0.1s ✔ Volume "docker_netbird_zitadel_certs" Created 0.0s ✔ Volume "docker_netbird_zdb_data" Created 0.0s ✔ Volume "docker_netbird_caddy_data" Created 0.0s ✔ Container docker-zdb-1 Healthy 5.9s ✔ Container docker-caddy-1 Started 0.4s ✔ Container docker-zitadel-1 Started 6.1s

Initializing Zitadel with NetBird's applications

Waiting for Zitadel's PAT to be created . . done Reading Zitadel PAT Waiting for Zitadel to become ready . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

[ingo@Docker02 docker]$ docker compose logs WARN[0000] /home/ingo/docker/docker-compose.yml: the attribute version is obsolete, it will be ignored, please remove it to avoid potential confusion zdb-1 | The files belonging to this database system will be owned by user "postgres". zdb-1 | This user must also own the server process. zdb-1 | zdb-1 | The database cluster will be initialized with locale "en_US.utf8". zdb-1 | The default database encoding has accordingly been set to "UTF8". zdb-1 | The default text search configuration will be set to "english". zdb-1 | zdb-1 | Data page checksums are disabled. zdb-1 | zdb-1 | fixing permissions on existing directory /var/lib/postgresql/data ... ok zdb-1 | creating subdirectories ... ok zdb-1 | selecting dynamic shared memory implementation ... posix zdb-1 | selecting default max_connections ... 100 zdb-1 | selecting default shared_buffers ... 128MB zdb-1 | selecting default time zone ... UTC zdb-1 | creating configuration files ... ok zdb-1 | running bootstrap script ... ok zdb-1 | sh: locale: not found zdb-1 | 2024-09-06 21:12:34.646 UTC [35] WARNING: no usable system locales were found zdb-1 | performing post-bootstrap initialization ... ok zdb-1 | syncing data to disk ... ok zdb-1 | zdb-1 | zdb-1 | Success. You can now start the database server using: zdb-1 | zdb-1 | pg_ctl -D /var/lib/postgresql/data -l logfile start zdb-1 | zdb-1 | initdb: warning: enabling "trust" authentication for local connections zdb-1 | initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. zdb-1 | waiting for server to start....2024-09-06 21:12:36.816 UTC [41] LOG: starting PostgreSQL 16.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 13.2.1_git20240309) 13.2.1 20240309, 64-bit zdb-1 | 2024-09-06 21:12:36.819 UTC [41] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" zdb-1 | 2024-09-06 21:12:36.828 UTC [44] LOG: database system was shut down at 2024-09-06 21:12:34 UTC zdb-1 | 2024-09-06 21:12:36.833 UTC [41] LOG: database system is ready to accept connections zdb-1 | done zdb-1 | server started zdb-1 | CREATE DATABASE zdb-1 | zdb-1 | zdb-1 | /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/ zdb-1 | zdb-1 | waiting for server to shut down....2024-09-06 21:12:36.942 UTC [41] LOG: received fast shutdown request zdb-1 | 2024-09-06 21:12:36.945 UTC [41] LOG: aborting any active transactions zdb-1 | 2024-09-06 21:12:36.946 UTC [41] LOG: background worker "logical replication launcher" (PID 47) exited with exit code 1 zdb-1 | 2024-09-06 21:12:36.946 UTC [42] LOG: shutting down zdb-1 | 2024-09-06 21:12:36.950 UTC [42] LOG: checkpoint starting: shutdown immediate zdb-1 | 2024-09-06 21:12:37.571 UTC [42] LOG: checkpoint complete: wrote 924 buffers (5.6%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.018 s, sync=0.590 s, total=0.625 s; sync files=301, longest=0.011 s, average=0.002 s; distance=4267 kB, estimate=4267 kB; lsn=0/191AB58, redo lsn=0/191AB58 zdb-1 | 2024-09-06 21:12:37.573 UTC [41] LOG: database system is shut down zdb-1 | done zdb-1 | server stopped zdb-1 | zdb-1 | PostgreSQL init process complete; ready for start up. zdb-1 | zdb-1 | 2024-09-06 21:12:37.658 UTC [1] LOG: starting PostgreSQL 16.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 13.2.1_git20240309) 13.2.1 20240309, 64-bit zdb-1 | 2024-09-06 21:12:37.658 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 zdb-1 | 2024-09-06 21:12:37.658 UTC [1] LOG: listening on IPv6 address "::", port 5432 zdb-1 | 2024-09-06 21:12:37.665 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" zdb-1 | 2024-09-06 21:12:37.672 UTC [57] LOG: database system was shut down at 2024-09-06 21:12:37 UTC zdb-1 | 2024-09-06 21:12:37.677 UTC [1] LOG: database system is ready to accept connections caddy-1 | {"level":"info","ts":1725657154.4168,"msg":"using config from file","file":"/etc/caddy/Caddyfile"} caddy-1 | {"level":"info","ts":1725657154.4185278,"msg":"adapted config to JSON","adapter":"caddyfile"} caddy-1 | {"level":"warn","ts":1725657154.4185376,"msg":"Caddyfile input is not formatted; run 'caddy fmt --overwrite' to fix inconsistencies","adapter":"caddyfile","file":"/etc/caddy/Caddyfile","line":2} caddy-1 | {"level":"info","ts":1725657154.420839,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//[::1]:2019","//127.0.0.1:2019","//localhost:2019"]} caddy-1 | {"level":"info","ts":1725657154.4210525,"logger":"http.auto_https","msg":"server is listening only on the HTTPS port but has no TLS connection policies; adding one to enable TLS","server_name":"srv0","https_port":443} caddy-1 | {"level":"info","ts":1725657154.4210615,"logger":"http.auto_https","msg":"enabling automatic HTTP->HTTPS redirects","server_name":"srv0"} caddy-1 | {"level":"warn","ts":1725657154.4211397,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv1","http_port":80} caddy-1 | {"level":"info","ts":1725657154.4212544,"logger":"tls.cache.maintenance","msg":"started background certificate maintenance","cache":"0xc0008f0c80"} caddy-1 | {"level":"debug","ts":1725657154.4211934,"logger":"http.auto_https","msg":"adjusted config","tls":{"automation":{"policies":[{}]}},"http":{"servers":{"srv0":{"listen":[":443"],"routes":[{"handle":[{"handler":"subroute","routes":[{"handle":[{"handler":"headers","response":{"deferred":true,"delete":["Server"],"set":{"Referrer-Policy":["strict-origin-when-cross-origin"],"Strict-Transport-Security":["max-age=3600; includeSubDomains; preload"],"X-Content-Type-Options":["nosniff"],"X-Frame-Options":["DENY"],"X-Xss-Protection":["1; mode=block"]}}}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.management.v1.ManagementService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.system.v1.SystemService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/.well-known/openid-configuration"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"signal:10000"}]}],"match":[{"path":["/signalexchange.SignalExchange/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.admin.v1.AdminService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"management:80"}]}],"match":[{"path":["/management.ManagementService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/zitadel.auth.v1.AuthService/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/management/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/system/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/assets/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/admin/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/oauth/v2/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/auth/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/oidc/v1/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/saml/v2/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/openapi/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/device/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/debug/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/device"]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"management:80"}]}],"match":[{"path":["/api/"]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}],"match":[{"path":["/ui/"]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"dashboard:80"}]}],"match":[{"path":["/*"]}]}]}],"terminal":true}],"tls_connection_policies":[{}],"automatic_https":{}},"srv1":{"listen":[":80"],"routes":[{},{"handle":[{"handler":"headers","response":{"deferred":true,"delete":["Server"],"set":{"Referrer-Policy":["strict-origin-when-cross-origin"],"Strict-Transport-Security":["max-age=3600; includeSubDomains; preload"],"X-Content-Type-Options":["nosniff"],"X-Frame-Options":["DENY"],"X-Xss-Protection":["1; mode=block"]}}}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"signal:10000"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"management:80"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"management:80"}]}]},{"handle":[{"handler":"reverse_proxy","transport":{"protocol":"http","versions":["h2c","2"]},"upstreams":[{"dial":"zitadel:8080"}]}]},{"handle":[{"handler":"reverse_proxy","upstreams":[{"dial":"dashboard:80"}]}]},{}],"automatic_https":{"disable":true}}}}} caddy-1 | {"level":"info","ts":1725657154.4226544,"logger":"http","msg":"enabling HTTP/3 listener","addr":":443"} caddy-1 | {"level":"info","ts":1725657154.4227445,"msg":"failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 7168 kiB, got: 416 kiB). See https://github.com/quic-go/quic-go/wiki/UDP-Buffer-Sizes for details."} caddy-1 | {"level":"debug","ts":1725657154.4228404,"logger":"http","msg":"starting server loop","address":"[::]:443","tls":true,"http3":true} caddy-1 | {"level":"info","ts":1725657154.4229102,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]} caddy-1 | {"level":"debug","ts":1725657154.4229472,"logger":"http","msg":"starting server loop","address":"[::]:80","tls":false,"http3":false} caddy-1 | {"level":"info","ts":1725657154.4229507,"logger":"http.log","msg":"server running","name":"srv1","protocols":["h1","h2","h3"]} caddy-1 | {"level":"info","ts":1725657154.422953,"logger":"http","msg":"enabling automatic TLS certificate management","domains":["netbird.grayhatlabs.com"]} caddy-1 | {"level":"info","ts":1725657154.4233918,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"} caddy-1 | {"level":"info","ts":1725657154.4233959,"msg":"serving initial configuration"} caddy-1 | {"level":"info","ts":1725657154.423417,"logger":"tls.obtain","msg":"acquiring lock","identifier":"netbird.grayhatlabs.com"} caddy-1 | {"level":"info","ts":1725657154.4263494,"logger":"tls","msg":"cleaning storage unit","storage":"FileStorage:/data/caddy"} caddy-1 | {"level":"info","ts":1725657154.4264882,"logger":"tls","msg":"finished cleaning storage units"} caddy-1 | {"level":"info","ts":1725657154.4300373,"logger":"tls.obtain","msg":"lock acquired","identifier":"netbird.grayhatlabs.com"} caddy-1 | {"level":"info","ts":1725657154.4300869,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"netbird.grayhatlabs.com"} caddy-1 | {"level":"debug","ts":1725657154.4301236,"logger":"events","msg":"event","name":"cert_obtaining","id":"65e2b213-f969-4b13-aef5-61fcf8817c43","origin":"tls","data":{"identifier":"netbird.grayhatlabs.com"}} caddy-1 | {"level":"debug","ts":1725657154.4302905,"logger":"tls.obtain","msg":"trying issuer 1/1","issuer":"acme-v02.api.letsencrypt.org-directory"} caddy-1 | {"level":"debug","ts":1725657154.4846947,"logger":"http.acme_client","msg":"http request","method":"GET","url":"https://acme-v02.api.letsencrypt.org/directory","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["746"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:34 GMT"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657154.5071867,"logger":"http.acme_client","msg":"http request","method":"HEAD","url":"https://acme-v02.api.letsencrypt.org/acme/new-nonce","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Date":["Fri, 06 Sep 2024 21:12:34 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["4OmWUlyUY-_HPprN59_xVlKJkt9O-YY_WTIxBaZsfyq8B33lRxk"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657154.7627168,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/new-acct","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["268"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:34 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\"","https://letsencrypt.org/documents/LE-SA-v1.4-April-3-2024.pdf;rel=\"terms-of-service\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/acct/1932803736"],"Replay-Nonce":["4OmWUlyUwLQvUn6DbpQlR0ooygqKnDg3g7k-49SNWv71jvx5sWQ"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201} caddy-1 | {"level":"info","ts":1725657154.763,"logger":"http","msg":"waiting on internal rate limiter","identifiers":["netbird.grayhatlabs.com"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":""} caddy-1 | {"level":"info","ts":1725657154.7630105,"logger":"http","msg":"done waiting on internal rate limiter","identifiers":["netbird.grayhatlabs.com"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":""} caddy-1 | {"level":"info","ts":1725657154.7630312,"logger":"http","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/1932803736","account_contact":[]} caddy-1 | {"level":"debug","ts":1725657154.7630374,"logger":"http.acme_client","msg":"creating order","account":"https://acme-v02.api.letsencrypt.org/acme/acct/1932803736","identifiers":["netbird.grayhatlabs.com"]} caddy-1 | {"level":"debug","ts":1725657155.0481026,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["349"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899632366"],"Replay-Nonce":["fCBw7MtQDPtAu8H7R6pUGWKlPokogCJg8vQLFMrPOTxYlardubU"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201} caddy-1 | {"level":"debug","ts":1725657155.0809524,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249459646","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["807"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["4OmWUlyUdqOAI1vcVFsJJOOZR76TlWmmCH-Eq-1_8CkjYvkPMBU"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657155.0810509,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"} caddy-1 | {"level":"info","ts":1725657155.0810542,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","ca":"https://acme-v02.api.letsencrypt.org/directory"} caddy-1 | {"level":"debug","ts":1725657155.081257,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"} caddy-1 | {"level":"debug","ts":1725657155.081264,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"} caddy-1 | {"level":"debug","ts":1725657155.134401,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249459646/Z2YT1w","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["187"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249459646;rel=\"up\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249459646/Z2YT1w"],"Replay-Nonce":["fCBw7MtQXprOm8Tes9OgN9ubIALvfQSuVKlGQTXrFn3xJuya5F8"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657155.1344252,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"} caddy-1 | {"level":"debug","ts":1725657155.4128547,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249459646","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["768"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:35 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["4OmWUlyUwpqIxrsigb0eA-Ru_RCfE7-_Cb3Z9uWdzvhkQkRwys0"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"error","ts":1725657155.4129443,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}} caddy-1 | {"level":"error","ts":1725657155.4129596,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899632366","attempt":1,"max_attempts":3} caddy-1 | {"level":"debug","ts":1725657156.4130719,"logger":"http.acme_client","msg":"creating order","account":"https://acme-v02.api.letsencrypt.org/acme/acct/1932803736","identifiers":["netbird.grayhatlabs.com"]} caddy-1 | {"level":"debug","ts":1725657156.7512052,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["349"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:36 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899638096"],"Replay-Nonce":["4OmWUlyUwrd-OjgVIoSvq08ri-qMP_DizBbRUvjffajKeL4R4_c"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201} zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="initialization started" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/init.go:75" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify user" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_user.go:39" username=zitadel zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify database" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_database.go:39" database=zitadel zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify grant" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_grant.go:34" database=zitadel user=zitadel zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify zitadel" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:78" database=zitadel zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify system" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:39" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify encryption keys" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:44" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify projections" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:49" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify eventstore" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:54" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify events tables" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:59" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify system sequence" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:64" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify unique constraints" caller="/home/runner/work/zitadel/zitadel/cmd/initialise/verify_zitadel.go:69" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="setup started" caller="/home/runner/work/zitadel/zitadel/cmd/setup/setup.go:99" zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=14_events_push zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=14_events_push zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=01_tables zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=01_tables zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=02_assets zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=02_assets zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=03_default_instance zitadel-1 | time="2024-09-06T21:12:40Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=03_default_instance zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=05_last_failed zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=05_last_failed zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=06_resource_owner_columns zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=06_resource_owner_columns zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=07_logstore zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=07_logstore zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=08_auth_token_indexes zitadel-1 | time="2024-09-06T21:12:41Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=08_auth_token_indexes zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=12_auth_users_otp_columns zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=12_auth_users_otp_columns zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=13_fix_quota_constraints zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=13_fix_quota_constraints zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=01_new_failed_events.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=02_fe_from_projections.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=03_fe_from_adminapi.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=04_fe_from_auth.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=05_current_states.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=06_cs_from_projections.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=07_cs_from_adminapi.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="execute statement" caller="/home/runner/work/zitadel/zitadel/cmd/setup/15.go:34" file=08_cs_from_auth.sql migration=15_current_projection_state zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=16_unique_constraint_lower zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=16_unique_constraint_lower zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="unique constraints updated" caller="/home/runner/work/zitadel/zitadel/cmd/setup/16.go:28" count=0 zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=17_add_offset_col_to_current_states zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=17_add_offset_col_to_current_states zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=19_add_current_sequences_index zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=19_add_current_sequences_index zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=20_add_by_user_index_on_session zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=20_add_by_user_index_on_session zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=22_active_instance_events_index zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=22_active_instance_events_index zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=23_correct_global_unique_constraints zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=23_correct_global_unique_constraints zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=24_add_actor_col_to_auth_tokens zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=24_add_actor_col_to_auth_tokens zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=26_auth_users3 zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=26_auth_users3 zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=config_change zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=config_change zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projection_tables zitadel-1 | time="2024-09-06T21:12:42Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projection_tables zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.orgs1 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.orgs1 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.actions3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.actions3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.projects4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.projects4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.domain_policies2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.domain_policies2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.label_policies3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.label_policies3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_roles4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_roles4 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.org_domains2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.org_domains2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.login_policies5 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.login_policies5 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idps3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idps3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.apps7 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.apps7 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idp_user_links3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idp_user_links3 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.message_texts2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.message_texts2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.users12 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.users12 zitadel-1 | time="2024-09-06T21:12:42Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.login_names3 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.login_names3 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.org_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.org_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instance_domains zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instance_domains zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.project_grant_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.project_grant_members4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_grants5 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_grants5 caddy-1 | {"level":"debug","ts":1725657156.7786167,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249467916","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["807"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:36 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["fCBw7MtQi7UyIcMIqz0iiBOV8V6iGrP60ApzpE9CDLMxRJI5Cnw"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657156.7786863,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"} zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_metadata5 caddy-1 | {"level":"info","ts":1725657156.778689,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","ca":"https://acme-v02.api.letsencrypt.org/directory"} caddy-1 | {"level":"debug","ts":1725657156.7790434,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"} caddy-1 | {"level":"debug","ts":1725657156.7790515,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"} zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_metadata5 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instances zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instances zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.notification_providers zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.notification_providers zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.keys4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.keys4 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.security_policies2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.security_policies2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.notification_policies zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.notification_policies zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.device_auth_requests2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.device_auth_requests2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.sessions8 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.sessions8 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.auth_requests zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.auth_requests zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.milestones zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.milestones caddy-1 | {"level":"debug","ts":1725657156.7790928,"logger":"http.stdlib","msg":"http: TLS handshake error from 127.0.0.1:48400: EOF"} caddy-1 | {"level":"debug","ts":1725657156.8206215,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249467916/BRcRyw","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["191"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:36 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249467916;rel=\"up\""],"Location":["https://acme-v02.api.letsencrypt.org/acme/chall-v3/400249467916/BRcRyw"],"Replay-Nonce":["fCBw7MtQ9Ygxg4uN37AK5MBVJMl-SaA_CyZYD8wHRVefm1fFcMI"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.quotas zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.quotas zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.limits caddy-1 | {"level":"debug","ts":1725657156.820654,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"} caddy-1 | {"level":"debug","ts":1725657157.1112025,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-v02.api.letsencrypt.org/acme/authz-v3/400249467916","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["1932803736"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["902"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:12:37 GMT"],"Link":["https://acme-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["fCBw7MtQcBPZua5Dfq7YZYjCllqQKwh-aHONogI81bCNRMZRNHk"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"error","ts":1725657157.1113408,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}} caddy-1 | {"level":"error","ts":1725657157.1113503,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/1932803736/302899638096","attempt":2,"max_attempts":3} caddy-1 | {"level":"error","ts":1725657157.111365,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"netbird.grayhatlabs.com","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain"} zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.limits caddy-1 | {"level":"debug","ts":1725657157.1113937,"logger":"events","msg":"event","name":"cert_failed","id":"66018c11-28e4-40fb-a42e-69a947134e2c","origin":"tls","data":{"error":{},"identifier":"netbird.grayhatlabs.com","issuers":["acme-v02.api.letsencrypt.org-directory"],"renewal":false}} caddy-1 | {"level":"error","ts":1725657157.1113992,"logger":"tls.obtain","msg":"will retry","error":"[netbird.grayhatlabs.com] Obtain: [netbird.grayhatlabs.com] solving challenge: netbird.grayhatlabs.com: [netbird.grayhatlabs.com] authorization failed: HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain (ca=https://acme-v02.api.letsencrypt.org/directory)","attempt":1,"retrying_in":60,"elapsed":2.681355266,"max_duration":2592000} caddy-1 | {"level":"info","ts":1725657217.1140587,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"netbird.grayhatlabs.com"} caddy-1 | {"level":"debug","ts":1725657217.1140976,"logger":"events","msg":"event","name":"cert_obtaining","id":"f5449649-6718-4eea-ad36-6f018c052321","origin":"tls","data":{"identifier":"netbird.grayhatlabs.com"}} caddy-1 | {"level":"debug","ts":1725657217.1142256,"logger":"tls.obtain","msg":"trying issuer 1/1","issuer":"acme-v02.api.letsencrypt.org-directory"} caddy-1 | {"level":"debug","ts":1725657217.1371498,"logger":"http.acme_client","msg":"http request","method":"GET","url":"https://acme-staging-v02.api.letsencrypt.org/directory","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["820"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657217.143803,"logger":"http.acme_client","msg":"http request","method":"HEAD","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-nonce","headers":{"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Cache-Control":["public, max-age=0, no-cache"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["6wrlOJ0TkPrI895NSM_0fkf1NCftBdNqcyn-8hpwrypdkkztu98"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657217.1727147,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-acct","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["267"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\"","https://letsencrypt.org/documents/LE-SA-v1.4-April-3-2024.pdf;rel=\"terms-of-service\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523"],"Replay-Nonce":["6wrlOJ0T0SFSuQdnAPaarI03njcxYJyU73a9nadZ-k7ulTPAFmw"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201} caddy-1 | {"level":"info","ts":1725657217.1728928,"logger":"http","msg":"using ACME account","account_id":"https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523","account_contact":[]} caddy-1 | {"level":"debug","ts":1725657217.172899,"logger":"http.acme_client","msg":"creating order","account":"https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523","identifiers":["netbird.grayhatlabs.com"]} caddy-1 | {"level":"debug","ts":1725657217.2257783,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["362"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272733"],"Replay-Nonce":["6wrlOJ0TKGJ8O5zVkbrU5Y-o458FhTIuCdof4pzUWCTV07XGQFo"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201} caddy-1 | {"level":"debug","ts":1725657217.2413557,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760363","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["828"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["_yLDrU7Hoy2f2fCYy-Wk89F1NPdTApV-RPCOu1SfCebO1XG4vYY"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657217.24139,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"} zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.restrictions2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.restrictions2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.system_features zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.system_features zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.instance_features2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.instance_features2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.targets1 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.targets1 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.executions1 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.executions1 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="executing check" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:202" execute=0 projection=projections.user_schemas zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="projection set up" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/init.go:209" execute=0 projection=projections.user_schemas zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=18_add_lower_fields_to_login_names zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=18_add_lower_fields_to_login_names zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=21_add_block_field_to_limits zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=21_add_block_field_to_limits caddy-1 | {"level":"info","ts":1725657217.2413924,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","ca":"https://acme-staging-v02.api.letsencrypt.org/directory"} caddy-1 | {"level":"debug","ts":1725657217.2416775,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"} caddy-1 | {"level":"debug","ts":1725657217.2416816,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"} caddy-1 | {"level":"debug","ts":1725657217.2417145,"logger":"http.stdlib","msg":"http: TLS handshake error from 127.0.0.1:59718: EOF"} caddy-1 | {"level":"debug","ts":1725657217.2581222,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760363/CfxIlQ","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["198"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760363;rel=\"up\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760363/CfxIlQ"],"Replay-Nonce":["_yLDrU7H0fDr7xI045d973XIJ1yMNCT2EDzPbutqLFKPL4gkCa0"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657217.2581508,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01"} caddy-1 | {"level":"debug","ts":1725657217.5190697,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760363","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["909"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:37 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["6wrlOJ0Ty5I7o3VLq5Mu8hhbNTu7klqU4uC99dRNqXjYBDx1Jcg"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"error","ts":1725657217.5191562,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"tls-alpn-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}} caddy-1 | {"level":"error","ts":1725657217.5191665,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272733","attempt":1,"max_attempts":3} caddy-1 | {"level":"debug","ts":1725657218.5196052,"logger":"http.acme_client","msg":"creating order","account":"https://acme-staging-v02.api.letsencrypt.org/acme/acct/162309523","identifiers":["netbird.grayhatlabs.com"]} caddy-1 | {"level":"debug","ts":1725657218.5664308,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/new-order","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["362"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272983"],"Replay-Nonce":["_yLDrU7HSXr-OTuVbDfBKhlKjoqL_jRm5CALq1-OVri0ZiZWRwU"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":201} caddy-1 | {"level":"debug","ts":1725657218.5791101,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760473","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["828"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["_yLDrU7HO8f6m7XDnMPU_xvpP5py2PHcJm-96fYAwEVMvMETHAc"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657218.579155,"logger":"http.acme_client","msg":"no solver configured","challenge_type":"dns-01"} caddy-1 | {"level":"info","ts":1725657218.5791583,"logger":"http.acme_client","msg":"trying to solve challenge","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","ca":"https://acme-staging-v02.api.letsencrypt.org/directory"} caddy-1 | {"level":"debug","ts":1725657218.5793295,"logger":"http.acme_client","msg":"waiting for solver before continuing","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"} caddy-1 | {"level":"debug","ts":1725657218.5793333,"logger":"http.acme_client","msg":"done waiting for solver","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"} caddy-1 | {"level":"debug","ts":1725657218.5926228,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760473/N8xjqw","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["194"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\"","https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760473;rel=\"up\""],"Location":["https://acme-staging-v02.api.letsencrypt.org/acme/chall-v3/13899760473/N8xjqw"],"Replay-Nonce":["6wrlOJ0TKE8z9X7zA5CeB0E_DhADp9tJxoeaUndwp_q3VKEwLbc"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"debug","ts":1725657218.592643,"logger":"http.acme_client","msg":"challenge accepted","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01"} caddy-1 | {"level":"debug","ts":1725657218.8550355,"logger":"http.acme_client","msg":"http request","method":"POST","url":"https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/13899760473","headers":{"Content-Type":["application/jose+json"],"User-Agent":["Caddy/2.8.4 CertMagic acmez (linux; amd64)"]},"response_headers":{"Boulder-Requester":["162309523"],"Cache-Control":["public, max-age=0, no-cache"],"Content-Length":["775"],"Content-Type":["application/json"],"Date":["Fri, 06 Sep 2024 21:13:38 GMT"],"Link":["https://acme-staging-v02.api.letsencrypt.org/directory;rel=\"index\""],"Replay-Nonce":["6wrlOJ0TGjDtnClqYQGncu1b7uDmlidMgHSv6Hp1f8I3gp-8Quc"],"Server":["nginx"],"Strict-Transport-Security":["max-age=604800"],"X-Frame-Options":["DENY"]},"status_code":200} caddy-1 | {"level":"error","ts":1725657218.8551793,"logger":"http.acme_client","msg":"challenge failed","identifier":"netbird.grayhatlabs.com","challenge_type":"http-01","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]}} caddy-1 | {"level":"error","ts":1725657218.8551881,"logger":"http.acme_client","msg":"validating authorization","identifier":"netbird.grayhatlabs.com","problem":{"type":"urn:ietf:params:acme:error:dns","title":"","detail":"DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain","instance":"","subproblems":[]},"order":"https://acme-staging-v02.api.letsencrypt.org/acme/order/162309523/18923272983","attempt":2,"max_attempts":3} caddy-1 | {"level":"error","ts":1725657218.8551986,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"netbird.grayhatlabs.com","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain"} caddy-1 | {"level":"debug","ts":1725657218.8552127,"logger":"events","msg":"event","name":"cert_failed","id":"c602a85e-8437-40eb-ae0b-3cd0a45db7c8","origin":"tls","data":{"error":{},"identifier":"netbird.grayhatlabs.com","issuers":["acme-v02.api.letsencrypt.org-directory"],"renewal":false}} caddy-1 | {"level":"error","ts":1725657218.8552167,"logger":"tls.obtain","msg":"will retry","error":"[netbird.grayhatlabs.com] Obtain: [netbird.grayhatlabs.com] solving challenge: netbird.grayhatlabs.com: [netbird.grayhatlabs.com] authorization failed: HTTP 400 urn:ietf:params:acme:error:dns - DNS problem: NXDOMAIN looking up A for netbird.grayhatlabs.com - check that a DNS record exists for this domain; DNS problem: NXDOMAIN looking up AAAA for netbird.grayhatlabs.com - check that a DNS record exists for this domain (ca=https://acme-staging-v02.api.letsencrypt.org/directory)","attempt":2,"retrying_in":120,"elapsed":64.425172808,"max_duration":2592000} zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=25_user12_add_lower_fields_to_verified_email zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=25_user12_add_lower_fields_to_verified_email zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=26_idp_templates6_add_saml_name_id_format zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=26_idp_templates6_add_saml_name_id_format zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="init-projections is currently in beta" caller="/home/runner/work/zitadel/zitadel/cmd/setup/setup.go:245" zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.orgs1 zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.orgs1 zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.orgs1 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.orgs1 zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.orgs1 took=120.622055ms zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:12:43Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:12:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.org_metadata2 took=114.449459ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.actions3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.actions3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.actions3 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.actions3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.actions3 took=115.912465ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.flow_triggers3 took=114.572138ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.projects4 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.projects4 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.projects4 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.projects4 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.projects4 took=114.953609ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.password_complexity_policies2 took=145.808795ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.password_age_policies2 took=115.165697ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.lockout_policies3 took=114.947168ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:12:44Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.privacy_policies4 took=115.079257ms zitadel-1 | time="2024-09-06T21:12:44Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.domain_policies2 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.domain_policies2 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.domain_policies2 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.domain_policies2 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.domain_policies2 took=114.767657ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.label_policies3 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.label_policies3 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.label_policies3 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.label_policies3 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.label_policies3 took=116.259232ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_grants4 took=114.717205ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_roles4 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_roles4 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_roles4 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_roles4 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_roles4 took=114.541318ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.org_domains2 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.org_domains2 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.org_domains2 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_domains2 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.org_domains2 took=115.813221ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.login_policies5 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.login_policies5 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.login_policies5 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_policies5 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.login_policies5 took=116.00462ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idps3 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idps3 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idps3 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idps3 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idps3 took=115.027995ms zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:12:45Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:12:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idp_templates6 took=115.379603ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.apps7 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.apps7 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.apps7 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.apps7 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.apps7 took=117.878048ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idp_user_links3 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idp_user_links3 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idp_user_links3 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_user_links3 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idp_user_links3 took=114.674204ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.idp_login_policy_links5 took=114.497805ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.mail_templates2 took=115.843677ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.message_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.message_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.message_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.message_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.message_texts2 took=122.246376ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.custom_texts2 took=121.512841ms zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.users12 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.users12 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.users12 zitadel-1 | time="2024-09-06T21:12:46Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.users12 zitadel-1 | time="2024-09-06T21:12:46Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.users12 took=117.107306ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.login_names3 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.login_names3 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.login_names3 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_names3 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.login_names3 took=116.576043ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.org_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.org_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.org_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.org_members4 took=128.59637ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instance_domains zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instance_domains zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instance_domains zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_domains zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instance_domains took=115.623607ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instance_members4 took=126.540324ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_members4 took=120.505342ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.project_grant_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.project_grant_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.project_grant_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_grant_members4 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.project_grant_members4 took=114.451749ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.authn_keys2 took=114.859292ms zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:12:47Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:12:47Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.personal_access_tokens3 took=115.605368ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_grants5 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_grants5 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_grants5 zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_grants5 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_grants5 took=114.804869ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_metadata5 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_metadata5 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_metadata5 zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_metadata5 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_metadata5 took=114.544904ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_auth_methods4 took=114.688767ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instances zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instances zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instances zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instances zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instances took=116.261317ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.secret_generators2 took=116.664226ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.smtp_configs2 took=114.642846ms zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:12:48Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.sms_configs2 took=114.726589ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.oidc_settings2 took=114.699615ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notification_providers zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notification_providers zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notification_providers zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_providers zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notification_providers took=114.823078ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.keys4 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.keys4 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.keys4 zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.keys4 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.keys4 took=114.56818ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.security_policies2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.security_policies2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.security_policies2 zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.security_policies2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.security_policies2 took=114.447392ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notification_policies zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notification_policies zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notification_policies zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_policies zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notification_policies took=114.865154ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.device_auth_requests2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.device_auth_requests2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.device_auth_requests2 zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.device_auth_requests2 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.device_auth_requests2 took=114.522899ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.sessions8 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.sessions8 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.sessions8 zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sessions8 zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.sessions8 took=114.585779ms zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.auth_requests zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.auth_requests zitadel-1 | time="2024-09-06T21:12:49Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.auth_requests zitadel-1 | time="2024-09-06T21:12:49Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.auth_requests zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.auth_requests took=114.536266ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.milestones zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.milestones zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.milestones zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.milestones zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.milestones took=116.435663ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.quotas zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.quotas zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.quotas zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.quotas zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.quotas took=114.519761ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.limits zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.limits zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.limits zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.limits zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.limits took=114.649282ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.restrictions2 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.restrictions2 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.restrictions2 zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.restrictions2 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.restrictions2 took=114.457616ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.system_features zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.system_features zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.system_features zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.system_features zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.system_features took=114.633516ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.instance_features2 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.instance_features2 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.instance_features2 zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_features2 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.instance_features2 took=114.932121ms zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.targets1 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.targets1 zitadel-1 | time="2024-09-06T21:12:50Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.targets1 zitadel-1 | time="2024-09-06T21:12:50Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.targets1 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.targets1 took=114.725968ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.executions1 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.executions1 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.executions1 zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.executions1 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.executions1 took=114.701679ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.user_schemas zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.user_schemas zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.user_schemas zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_schemas zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.user_schemas took=114.733491ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=adminapi.styling2 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=adminapi.styling2 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=adminapi.styling2 zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=adminapi.styling2 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=adminapi.styling2 took=46.113489ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.users3 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.users3 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.users3 zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.users3 zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.users3 took=14.811601ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.user_sessions zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.user_sessions zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.user_sessions zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.user_sessions zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.user_sessions took=14.851686ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.tokens took=17.305914ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=auth.refresh_tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=auth.refresh_tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=auth.refresh_tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.refresh_tokens zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=auth.refresh_tokens took=14.310929ms zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notifications zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notifications zitadel-1 | time="2024-09-06T21:12:51Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notifications zitadel-1 | time="2024-09-06T21:12:51Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notifications took=1.017515356s zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="verify migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:43" name=projections.notifications_quota zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="starting migration" caller="/home/runner/work/zitadel/zitadel/internal/migration/migration.go:66" name=projections.notifications_quota zitadel-1 | time="2024-09-06T21:12:52Z" level=info msg="projection starts prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:72" projection=projections.notifications_quota zitadel-1 | time="2024-09-06T21:12:52Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications_quota zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="projections ended prefilling" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:115" projection=projections.notificationsquota took=1.014346924s zitadel-1 | ____ _ ___ _ zitadel-1 | | / | | | | / \ | \ | ____| | | zitadel-1 | / / | | | | / \ | | | | | | | | zitadel-1 | / / | | | | / _ \ | || | | | | |_ zitadel-1 | /| |__| || // \\ |/ || || zitadel-1 | zitadel-1 | =============================================================== zitadel-1 | zitadel-1 | Version : v2.54.3 zitadel-1 | TLS enabled : false zitadel-1 | External Secure : true zitadel-1 | Console URL : https://netbird.grayhatlabs.com:443/ui/console zitadel-1 | Health Check URL : https://netbird.grayhatlabs.com:443/debug/healthz zitadel-1 | zitadel-1 | =============================================================== zitadel-1 | zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="auth request cache disabled" caller="/home/runner/work/zitadel/zitadel/internal/auth_request/repository/cache/cache.go:31" error="must provide a positive size" zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="auth request cache disabled" caller="/home/runner/work/zitadel/zitadel/internal/auth_request/repository/cache/cache.go:36" error="must provide a positive size" zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/authorize zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/device_authorization zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/token zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/introspect zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oidc/v1/userinfo zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/revoke zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oidc/v1/end_session zitadel-1 | time=2024-09-06T21:12:53.880Z level=INFO msg="registered route" endpoint=/oauth/v2/keys zitadel-1 | time="2024-09-06T21:12:53Z" level=info msg="server is listening on [::]:8080" caller="/home/runner/work/zitadel/zitadel/cmd/start/start.go:514" zitadel-1 | time="2024-09-06T21:12:55Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_grants4 zitadel-1 | time="2024-09-06T21:12:56Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.actions3 zitadel-1 | time="2024-09-06T21:12:56Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.smtp_configs2 zitadel-1 | time="2024-09-06T21:12:57Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_members4 zitadel-1 | time="2024-09-06T21:12:59Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.orgs1 zitadel-1 | time="2024-09-06T21:13:00Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_members4 zitadel-1 | time="2024-09-06T21:13:00Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_names3 zitadel-1 | time="2024-09-06T21:13:00Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.apps7 zitadel-1 | time="2024-09-06T21:13:01Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_roles4 zitadel-1 | time="2024-09-06T21:13:03Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_metadata5 zitadel-1 | time="2024-09-06T21:13:05Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.system_features zitadel-1 | time="2024-09-06T21:13:07Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.authn_keys2 zitadel-1 | time="2024-09-06T21:13:08Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.project_members4 zitadel-1 | time="2024-09-06T21:13:08Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.projects4 zitadel-1 | time="2024-09-06T21:13:09Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.oidc_settings2 zitadel-1 | time="2024-09-06T21:13:09Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.quotas zitadel-1 | time="2024-09-06T21:13:10Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.flow_triggers3 zitadel-1 | time="2024-09-06T21:13:11Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_auth_methods4 zitadel-1 | time="2024-09-06T21:13:13Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.tokens zitadel-1 | time="2024-09-06T21:13:13Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.message_texts2 zitadel-1 | time="2024-09-06T21:13:15Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications zitadel-1 | time="2024-09-06T21:13:17Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_policies zitadel-1 | time="2024-09-06T21:13:19Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_complexity_policies2 zitadel-1 | time="2024-09-06T21:13:19Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.keys4 zitadel-1 | time="2024-09-06T21:13:20Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_metadata2 zitadel-1 | time="2024-09-06T21:13:21Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.executions1 zitadel-1 | time="2024-09-06T21:13:23Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.lockout_policies3 zitadel-1 | time="2024-09-06T21:13:24Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.password_age_policies2 zitadel-1 | time="2024-09-06T21:13:28Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.auth_requests zitadel-1 | time="2024-09-06T21:13:29Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.security_policies2 zitadel-1 | time="2024-09-06T21:13:31Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.milestones zitadel-1 | time="2024-09-06T21:13:31Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_templates6 zitadel-1 | time="2024-09-06T21:13:33Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_features2 zitadel-1 | time="2024-09-06T21:13:33Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.idp_login_policy_links5 zitadel-1 | time="2024-09-06T21:13:34Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.label_policies3 zitadel-1 | time="2024-09-06T21:13:35Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_grants5 zitadel-1 | time="2024-09-06T21:13:35Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.secret_generators2 zitadel-1 | time="2024-09-06T21:13:36Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instances zitadel-1 | time="2024-09-06T21:13:36Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.targets1 zitadel-1 | time="2024-09-06T21:13:37Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.org_domains2 zitadel-1 | time="2024-09-06T21:13:38Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sessions8 zitadel-1 | time="2024-09-06T21:13:39Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.sms_configs2 zitadel-1 | time="2024-09-06T21:13:39Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=adminapi.styling2 zitadel-1 | time="2024-09-06T21:13:39Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.mail_templates2 zitadel-1 | time="2024-09-06T21:13:40Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notification_providers zitadel-1 | time="2024-09-06T21:13:41Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.personal_access_tokens3 zitadel-1 | time="2024-09-06T21:13:41Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.custom_texts2 zitadel-1 | time="2024-09-06T21:13:42Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.instance_domains zitadel-1 | time="2024-09-06T21:13:42Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.limits zitadel-1 | time="2024-09-06T21:13:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.login_policies5 zitadel-1 | time="2024-09-06T21:13:43Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.privacy_policies4 zitadel-1 | time="2024-09-06T21:13:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.user_schemas zitadel-1 | time="2024-09-06T21:13:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=auth.tokens zitadel-1 | time="2024-09-06T21:13:45Z" level=debug msg="trigger iteration" caller="/home/runner/work/zitadel/zitadel/internal/eventstore/handler/v2/handler.go:414" iteration=0 projection=projections.notifications