search

ChainSafe / lodestar

🌟 TypeScript Implementation of Ethereum Consensus
https://lodestar.chainsafe.io
Apache License 2.0
1.16k stars 286 forks source link

Generate valid states and blocks for CI testing #4017

Open dapplion opened 2 years ago

dapplion commented 2 years ago

Describe the bug

Current master depends on Infura to download some states and blocks for benchmarking. While this has worked fine before currently Infura timeouts for all requests. The problem is that these states are really old and Infura places some limit on the credentials. I've rotated the credentials with a new account but it still timeouts.

Depending on external services weakens our CI. This issue is blocking https://github.com/ChainSafe/lodestar/pull/3995

Proposed solution

Build generic infra to generate valid states and blocks on demand and cache them locally. We already have something like that for benchmarking but should be extended and persisted.

philknows commented 11 months ago

Related to #4031. Need to also generate state in the benchmark with >1M validators instead of 250_000

philknows commented 11 months ago

Related to #4031. Need to also generate state in the benchmark with >1M validators instead of 250_000 @tuyennhv

wemeetagain commented 2 days ago

iirc @matthewkeil may have done something related this?