Interop post-mortem - Githubissues

ensi321 commented 6 months ago

Problem description

Curated list of things to that can be improved on after Lodestar's team experience in interop

Issue List

Docker image builds slowly.
Debugger spins up slowly and skips breakpoints
Github CI is not cacheing spec-test and downloads every time
Several workarounds have been deployed for devnet-0. Need to implement permanent solution
skippedTestSuites and skippedTests in specTestIterator.ts are not applied to transition.test.ts, fork_choie.test.ts and epoch_processing.test.ts
attestation pool cache (and other caches) are sometimes hard to debug, we should either improve the logging or a better solution might be to add apis to dump caches to more easily observe the cached items
conformance testing of engine-api, they have tests and schemas that we can test against https://github.com/ethereum/execution-apis/
better validation of engine-api

Solution description

Issues will be opened separately once the list is curated

Additional context

No response

jeluard commented 6 months ago

PR cutting Docker build time by 2. Note that the current Docker build creates a multi-platform Docker image (arm64 and amd64). We can probably improve things further by having a dedicated Docker build for local usage.

twoeths commented 6 months ago

need e2e tests with more than 1 node + multiple committees per slot for electra

twoeths commented 6 months ago

need to add oppool metrics to grafana

wemeetagain commented 6 months ago

poor sync committee block packing after skip slots

ChainSafe / lodestar

Interop post-mortem #6781

Problem description

Issue List

Solution description

Additional context