Interop post-mortem

[ensi321]

Problem description

Curated list of things to that can be improved on after Lodestar's team experience in interop

Issue List

• Docker image builds slowly.
• Debugger spins up slowly and skips breakpoints
• Github CI is not cacheing spec-test and downloads every time
• Several workarounds have been deployed for devnet-0. Need to implement permanent solution
• skippedTestSuites and skippedTests in specTestIterator.ts are not applied to transition.test.ts, fork_choie.test.ts and epoch_processing.test.ts
• attestation pool cache (and other caches) are sometimes hard to debug, we should either improve the logging or a better solution might be to add apis to dump caches to more easily observe the cached items
• conformance testing of engine-api, they have tests and schemas that we can test against https://github.com/ethereum/execution-apis/
• better validation of engine-api

Solution description

Issues will be opened separately once the list is curated

Additional context

No response

[jeluard]

PR cutting Docker build time by 2. Note that the current Docker build creates a multi-platform Docker image (arm64 and amd64). We can probably improve things further by having a dedicated Docker build for local usage.

[twoeths]

need e2e tests with more than 1 node + multiple committees per slot for electra

[twoeths]

need to add oppool metrics to grafana

[wemeetagain]

poor sync committee block packing after skip slots