search

Consensys / web3signer

Web3Signer is an open-source signing service capable of signing on multiple platforms (Ethereum1 and 2, Filecoin) using private keys stored in an external vault, or encrypted on a disk.
https://docs.web3signer.consensys.net/
Apache License 2.0
183 stars 68 forks source link

ERROR: duplicate key value violates unique constraint "metadata_pkey" #978

Closed preethiLN closed 3 months ago

preethiLN commented 3 months ago

ERROR: duplicate key value violates unique constraint "metadata_pkey : This error is occurring after starting postgres container . We are facing this issue after upgrading to postgres:14.9 from postgres:12. The data from previous version has been deleted before starting the new version.

Web3signer or teku validator client does not show any errors during this timestamp. No attestations are missed.

We are getting this error when postgres is initiated. Log file is attached below

postgres_logs.txt

usmansaleem commented 3 months ago

Relevant postgresql log:

2024-03-08 10:50:38.072 UTC [115] LOG:  connection authorized: user=postgres database=web3signer SSL enabled (protocol=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384, bits=256)
2024-03-08 10:50:46.219 UTC [113] ERROR:  duplicate key value violates unique constraint "metadata_pkey"
2024-03-08 10:50:46.219 UTC [113] DETAIL:  Key (id)=(1) already exists.
2024-03-08 10:50:46.219 UTC [113] STATEMENT:  INSERT INTO metadata (id, genesis_validators_root) VALUES ($1, $2)
2024-03-08 10:50:46.219 UTC [112] ERROR:  duplicate key value violates unique constraint "metadata_pkey"
2024-03-08 10:50:46.219 UTC [112] DETAIL:  Key (id)=(1) already exists.
2024-03-08 10:50:46.219 UTC [112] STATEMENT:  INSERT INTO metadata (id, genesis_validators_root) VALUES ($1, $2)
2024-03-08 10:50:46.220 UTC [109] ERROR:  duplicate key value violates unique constraint "metadata_pkey"

@preethiLN Are there any logs reported in Web3Signer on the same timestamp?

preethiLN commented 3 months ago

Here are the logs from web3signer on the same timestamp:


2024-03-08 10:50:37.557+00:00 | main | INFO  | HikariPool | HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@64f9f455
2024-03-08 10:50:37.559+00:00 | main | INFO  | HikariDataSource | HikariPool-1 - Start completed.
2024-03-08 10:50:37.755+00:00 | main | INFO  | HikariDataSource | HikariPool-2 - Starting...
2024-03-08 10:50:37.829+00:00 | main | INFO  | HikariPool | HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@2443135
2024-03-08 10:50:37.830+00:00 | main | INFO  | HikariDataSource | HikariPool-2 - Start completed.
2024-03-08 10:50:38.057+00:00 | main | INFO  | MetricsHttpService | Starting metrics http service on 0.0.0.0:9001
2024-03-08 10:50:38.170+00:00 | vert.x-eventloop-thread-0 | INFO  | MetricsHttpService | Metrics service started and listening on 0.0.0.0:9001
2024-03-08 10:50:38.189+00:00 | pool-2-thread-1 | INFO  | SignerLoader | Loading signer configuration metadata files from /web3config
2024-03-08 10:50:38.196+00:00 | pool-2-thread-1 | INFO  | SignerLoader | Signer configuration metadata files read in memory 1 in 00:00:00.004
2024-03-08 10:50:38.367+00:00 | pool-2-thread-1 | INFO  | SignerLoader | Converting signing metadata to Artifact Signer using parallel streams ...
2024-03-08 10:50:38.370+00:00 | ForkJoinPool.commonPool-worker-10 | INFO  | SignerLoader | 10 signing metadata processed
2024-03-08 10:50:38.525+00:00 | ForkJoinPool.commonPool-worker-19 | INFO  | SignerLoader | 20 signing metadata processed
2024-03-08 10:50:38.577+00:00 | ForkJoinPool.commonPool-worker-4 | INFO  | BLS | BLS: loaded BLST library
2024-03-08 10:50:38.585+00:00 | ForkJoinPool.commonPool-worker-27 | INFO  | SignerLoader | 30 signing metadata processed
2024-03-08 10:50:38.586+00:00 | ForkJoinPool.commonPool-worker-20 | INFO  | SignerLoader | 40 signing metadata processed
2024-03-08 10:50:38.590+00:00 | ForkJoinPool.commonPool-worker-26 | INFO  | SignerLoader | 50 signing metadata processed
2024-03-08 10:50:38.592+00:00 | ForkJoinPool.commonPool-worker-11 | INFO  | SignerLoader | 60 signing metadata processed
2024-03-08 10:50:38.597+00:00 | ForkJoinPool.commonPool-worker-10 | INFO  | SignerLoader | 70 signing metadata processed
2024-03-08 10:50:38.601+00:00 | ForkJoinPool.commonPool-worker-18 | INFO  | SignerLoader | 80 signing metadata processed
2024-03-08 10:50:38.604+00:00 | ForkJoinPool.commonPool-worker-11 | INFO  | SignerLoader | 90 signing metadata processed
2024-03-08 10:50:38.609+00:00 | ForkJoinPool.commonPool-worker-26 | INFO  | SignerLoader | 100 signing metadata processed
2024-03-08 10:50:38.612+00:00 | ForkJoinPool.commonPool-worker-27 | INFO  | SignerLoader | 110 signing metadata processed
2024-03-08 10:50:38.618+00:00 | pool-2-thread-1 | INFO  | SignerLoader | 120 signing metadata processed
2024-03-08 10:50:38.621+00:00 | ForkJoinPool.commonPool-worker-6 | INFO  | SignerLoader | 130 signing metadata processed
2024-03-08 10:50:38.625+00:00 | ForkJoinPool.commonPool-worker-22 | INFO  | SignerLoader | 140 signing metadata processed
2024-03-08 10:50:38.630+00:00 | pool-2-thread-1 | INFO  | SignerLoader | 150 signing metadata processed
2024-03-08 10:50:38.635+00:00 | ForkJoinPool.commonPool-worker-19 | INFO  | SignerLoader | 160 signing metadata processed
2024-03-08 10:50:38.640+00:00 | ForkJoinPool.commonPool-worker-11 | INFO  | SignerLoader | 170 signing metadata processed
2024-03-08 10:50:38.645+00:00 | ForkJoinPool.commonPool-worker-13 | INFO  | SignerLoader | 180 signing metadata processed
2024-03-08 10:50:38.652+00:00 | ForkJoinPool.commonPool-worker-5 | INFO  | SignerLoader | 190 signing metadata processed
2024-03-08 10:50:38.654+00:00 | ForkJoinPool.commonPool-worker-3 | INFO  | SignerLoader | 200 signing metadata processed
2024-03-08 10:50:38.661+00:00 | ForkJoinPool.commonPool-worker-9 | INFO  | SignerLoader | 210 signing metadata processed
2024-03-08 10:50:38.664+00:00 | ForkJoinPool.commonPool-worker-24 | INFO  | SignerLoader | 220 signing metadata processed
2024-03-08 10:50:38.670+00:00 | ForkJoinPool.commonPool-worker-4 | INFO  | SignerLoader | 230 signing metadata processed
2024-03-08 10:50:38.675+00:00 | ForkJoinPool.commonPool-worker-33 | INFO  | SignerLoader | 240 signing metadata processed
2024-03-08 10:50:38.680+00:00 | ForkJoinPool.commonPool-worker-11 | INFO  | SignerLoader | 250 signing metadata processed
2024-03-08 10:50:38.684+00:00 | ForkJoinPool.commonPool-worker-26 | INFO  | SignerLoader | 260 signing metadata processed
2024-03-08 10:50:38.691+00:00 | ForkJoinPool.commonPool-worker-15 | INFO  | SignerLoader | 270 signing metadata processed
2024-03-08 10:50:38.695+00:00 | ForkJoinPool.commonPool-worker-19 | INFO  | SignerLoader | 280 signing metadata processed
2024-03-08 10:50:38.698+00:00 | ForkJoinPool.commonPool-worker-18 | INFO  | SignerLoader | 290 signing metadata processed
2024-03-08 10:50:38.707+00:00 | ForkJoinPool.commonPool-worker-17 | INFO  | SignerLoader | 300 signing metadata processed
2024-03-08 10:50:38.713+00:00 | ForkJoinPool.commonPool-worker-39 | INFO  | SignerLoader | 310 signing metadata processed
2024-03-08 10:50:38.714+00:00 | ForkJoinPool.commonPool-worker-42 | INFO  | SignerLoader | 320 signing metadata processed
2024-03-08 10:50:38.716+00:00 | ForkJoinPool.commonPool-worker-11 | INFO  | SignerLoader | 330 signing metadata processed
2024-03-08 10:50:38.720+00:00 | ForkJoinPool.commonPool-worker-7 | INFO  | SignerLoader | 340 signing metadata processed
2024-03-08 10:50:38.723+00:00 | ForkJoinPool.commonPool-worker-13 | INFO  | SignerLoader | 350 signing metadata processed
2024-03-08 10:50:38.729+00:00 | ForkJoinPool.commonPool-worker-31 | INFO  | SignerLoader | 360 signing metadata processed
2024-03-08 10:50:38.735+00:00 | ForkJoinPool.commonPool-worker-11 | INFO  | SignerLoader | 370 signing metadata processed
2024-03-08 10:50:38.739+00:00 | ForkJoinPool.commonPool-worker-22 | INFO  | SignerLoader | 380 signing metadata processed
2024-03-08 10:50:38.743+00:00 | ForkJoinPool.commonPool-worker-14 | INFO  | SignerLoader | 390 signing metadata processed
2024-03-08 10:50:38.746+00:00 | pool-2-thread-1 | INFO  | SignerLoader | 400 signing metadata processed
2024-03-08 10:50:38.749+00:00 | ForkJoinPool.commonPool-worker-9 | INFO  | SignerLoader | 410 signing metadata processed
2024-03-08 10:50:38.754+00:00 | ForkJoinPool.commonPool-worker-5 | INFO  | SignerLoader | 420 signing metadata processed
2024-03-08 10:50:38.758+00:00 | ForkJoinPool.commonPool-worker-15 | INFO  | SignerLoader | 430 signing metadata processed
2024-03-08 10:50:38.764+00:00 | ForkJoinPool.commonPool-worker-15 | INFO  | SignerLoader | 440 signing metadata processed
2024-03-08 10:50:38.768+00:00 | ForkJoinPool.commonPool-worker-9 | INFO  | SignerLoader | 450 signing metadata processed
2024-03-08 10:50:38.780+00:00 | ForkJoinPool.commonPool-worker-36 | INFO  | SignerLoader | 460 signing metadata processed
2024-03-08 10:50:38.786+00:00 | ForkJoinPool.commonPool-worker-19 | INFO  | SignerLoader | 470 signing metadata processed
2024-03-08 10:50:38.794+00:00 | ForkJoinPool.commonPool-worker-37 | INFO  | SignerLoader | 480 signing metadata processed
2024-03-08 10:50:38.804+00:00 | ForkJoinPool.commonPool-worker-40 | INFO  | SignerLoader | 490 signing metadata processed
2024-03-08 10:50:38.815+00:00 | ForkJoinPool.commonPool-worker-40 | INFO  | SignerLoader | 500 signing metadata processed
2024-03-08 10:50:38.830+00:00 | pool-2-thread-1 | INFO  | SignerLoader | Total Artifact Signer loaded via configuration files: 500
Error count 0
Time Taken: 00:00:00.633.
2024-03-08 10:50:39.016+00:00 | pool-2-thread-1 | INFO  | RegisteredValidators | Validators registered successfully in database:500
2024-03-08 10:50:39.021+00:00 | pool-2-thread-1 | INFO  | DefaultArtifactSignerProvider | Total signers (keys) currently loaded in memory: 500
2024-03-08 10:50:39.041+00:00 | main | INFO  | Runner | Web3Signer has started with TLS disabled, and ready to handle signing requests on 0.0.0.0:9000
2024-03-08 22:50:39.045+00:00 | pool-3-thread-1 | INFO  | DBSlashingProtectionPruner | Pruning slashing protection database for 500 validators
2024-03-08 22:50:42.745+00:00 | pool-3-thread-1 | INFO  | DBSlashingProtectionPruner | Pruning slashing protection database complete
2024-03-09 10:50:39.043+00:00 | pool-3-thread-1 | INFO  | DBSlashingProtectionPruner | Pruning slashing protection database for 500 validators
2024-03-09 10:50:42.533+00:00 | pool-3-thread-1 | INFO  | DBSlashingProtectionPruner | Pruning slashing protection database complete```