MinaProtocol / mina

Mina is a cryptocurrency protocol with a constant size blockchain, improving scaling while maintaining decentralization and security.
https://minaprotocol.com
Apache License 2.0
1.98k stars 525 forks source link

Devnet mina-archive cannot load precomputed block 1582 #15449

Open jrwashburn opened 4 months ago

jrwashburn commented 4 months ago

Block 1582 from the O1 precomputed storage on GCS is invalid, or there is a bug in the block loader:

Apr 03 00:33:25 nym3 bash[2806445]: Downloading devnet-1582-3NLZQcjScyXEhitHToSb31RbAWQ3AqJRLxqLxNAo17YmTLYteGyk.json block
Apr 03 00:33:25 nym3 bash[2806445]: Block devnet-1582-3NLZQcjScyXEhitHToSb31RbAWQ3AqJRLxqLxNAo17YmTLYteGyk.json found in bucket, downloaded.
Apr 03 00:33:25 nym3 bash[2806445]: Attempting to populate archive db with devnet-1582-3NLZQcjScyXEhitHToSb31RbAWQ3AqJRLxqLxNAo17YmTLYteGyk.json
Apr 03 00:33:25 nym3 bash[2806732]: (monitor.ml.Error "Internal command statuses did not match"
Apr 03 00:33:25 nym3 bash[2806732]:  ("Raised at Base__Error.raise in file \"src/error.ml\" (inlined), line 8, characters 14-30"
Apr 03 00:33:25 nym3 bash[2806732]:   "Called from Caqti_async.Fiber.finally.(fun) in file \"caqti-async/lib/caqti_async.ml\", line 44, characters 39-69"
Apr 03 00:33:25 nym3 bash[2806732]:   "Called from Async_kernel__Deferred1.M.map.(fun) in file \"src/deferred1.ml\", line 17, characters 40-45"
Apr 03 00:33:25 nym3 bash[2806732]:   "Called from Async_kernel__Job_queue.run_job in file \"src/job_queue.ml\" (inlined), line 128, characters 2-5"
Apr 03 00:33:25 nym3 bash[2806732]:   "Called from Async_kernel__Job_queue.run_jobs in file \"src/job_queue.ml\", line 169, characters 6-47"))

Backup db provided here: https://drive.google.com/file/d/1t3KZsO3a0sVsxeKEOweV6RGmYimyueVS/view?usp=sharing to reproduce.

Steps to Reproduce

  1. try to load block 1582 from precomputed to an archive db.
  2. ...

Expected Result

block will load

Actual Result

error message: Internal command statuses did not match

Daemon version

apt list --installed | grep mina

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

mina-archive-maintenance/unknown,now 1.4.0beta2-compatible-060f0a5 amd64 [installed]
mina-archive-migration/unknown,now 3.0.0devnet-tooling-6e92017 amd64 [installed,upgradable to: 3.0.0devnet-tooling-5792b50]
mina-archive/now 1.4.0beta2-fix-compatible-caqti-pool-785eac7 amd64 [installed,upgradable to: 3.0.0devnet-tooling-5792b50]
mina-devnet/now 1.4.1alpha1-3f42da6 amd64 [installed,local]
mina-logproc/now 1.4.1alpha1-3f42da6 amd64 [installed,upgradable to: 3.0.0devnet-tooling-5792b50]

How frequently do you see this issue?

Always

What is the impact of this issue on your ability to run a node?

Blocker

Status

Blocks upgrade of devnet.
jrwashburn commented 4 months ago

Also note: It seems like 1582 was stored differently - e.g. when you open the url it just opens instead of prompting download and it's returning as application/json instead of application/octet-stream like the other blocks.

jrwashburn commented 4 months ago

Team provided extensional blocks: gs://mina_network_block_data/devnet-extensional-bundle.tar.gz Loading now...