ethpandaops / ethereum-package

A Kurtosis package that deploys a private, portable, and modular Ethereum devnet
MIT License
243 stars 135 forks source link

failed to shadow mainnet with error ailed to execute command '[cat /tmp/finished]' #729

Closed BlueShells closed 2 months ago

BlueShells commented 2 months ago

error to start shadowfork-el-1-geth-lighthouse

'$Failed to execute command '[cat /tmp/finished]' on service 'shadowfork-el-1-geth-lighthouse'
  Caused by: An error occurred running exec command '[cat /tmp/finished]' on service 'shadowfork-el-1-geth-lighthouse' (uuid 'b73f063c99994fb4944ed79eed1c1289')

There was an error executing Starlark code
An error occurred executing instruction (number 8) at github.com/ethpandaops/ethereum-package/src/network_launcher/shadowfork.star[102:18]:
  wait(service_name="shadowfork-el-1-geth-lighthouse", recipe=ExecRecipe(command=["cat", "/tmp/finished"]), field="code", assertion="==", target_value=0, interval="1s", timeout="6h")

I debug the log of docker :

fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/main/x86_64/APKINDEX.tar.gz
fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/community/x86_64/APKINDEX.tar.gz
(1/14) Installing ca-certificates (20240226-r0)
(2/14) Installing brotli-libs (1.1.0-r1)
(3/14) Installing c-ares (1.27.0-r0)
(4/14) Installing libunistring (1.1-r2)
(5/14) Installing libidn2 (2.3.4-r4)
(6/14) Installing nghttp2-libs (1.58.0-r0)
(7/14) Installing libcurl (8.9.0-r0)
(8/14) Installing curl (8.9.0-r0)
(9/14) Installing libacl (2.3.1-r4)
(10/14) Installing tar (1.35-r2)
(11/14) Installing libgcc (13.2.1_git20231014-r0)
(12/14) Installing libstdc++ (13.2.1_git20231014-r0)
(13/14) Installing zstd-libs (1.5.5-r8)
(14/14) Installing zstd (1.5.5-r8)
Executing busybox-1.36.1-r15.trigger
Executing ca-certificates-20240226-r0.trigger
OK: 16 MiB in 29 packages
zstd: /*stdin*\: unsupported format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/main/x86_64/APKINDEX.tar.gz
fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/community/x86_64/APKINDEX.tar.gz
OK: 16 MiB in 29 packages
zstd: /*stdin*\: unsupported format
tar: Child returned status 1
tar: Error is not recoverable: exiting now

my config :

participants:
  - el_type: geth
    el_image: ethereum/client-go:v1.13.14
    cl_type: lighthouse
    cl_image: sigp/lighthouse:latest
    el_volume_size: 100000
network_params:
  network: mainnet-shadowfork
snooper_enabled: true
persistent: true

my command :

sudo kurtosis run --enclave my-testnet github.com/ethpandaops/ethereum-package --args-file network_params.yaml

commit:

0ed1c9c8e974f7c6900f68679602d95cfcb17831 
BlueShells commented 2 months ago

might caused by

curl -s -L https://ethpandaops-ethereum-node-snapshots.ams3.cdn.digitaloceanspaces.com/mainnet/geth/latest/snapshot.tar.zst
<?xml version="1.0" encoding="UTF-8"?><Error><Code>NoSuchKey</Code><Message></Message><BucketName>ethpandaops-ethereum-node-snapshots</BucketName><RequestId>tx00000b79ebf58cfd0a443-0066ab7053-673d5dbc-ams3c</RequestId><HostId>673d5dbc-ams3c-ams3-zg03</HostId></Error>/
barnabasbusa commented 2 months ago

We don't support mainnet shadowfork, as they would require TBs of data transfers, which is not something we will support publicly. You would need to have a local snapshot or provide your own bucket if you want to proceed with a mainnet shadowfork.