search

BoostryJP / ibet-Network

ibet Blockchain Network 🔗
https://ibet.jp/ibet-for-fin
GNU Lesser General Public License v3.0
11 stars 3 forks source link

[FEATURE] v1.3 -> v2.0 #96

Closed YoshihitoAso closed 2 years ago

YoshihitoAso commented 2 years ago

Is your feature request related to a problem? Please describe.

YoshihitoAso commented 2 years ago

Quorum v21.1 -> v22.1 移行調査結果（その１）

ValidatorノードとGeneral（non-Validator）ノードのバージョン混在に関する検証

1. Validatorノードのみをアップグレード

初期状態におけるGeneralノードの稼働ログは以下の通り。

INFO [05-12|12:48:47.767] Maximum peer count                       ETH=50 LES=0 total=50
INFO [05-12|12:48:47.768] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
WARN [05-12|12:48:47.790] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
INFO [05-12|12:48:47.792] Allocated cache and file handles         database=/eth/geth/chaindata cache=16.00MiB handles=16
INFO [05-12|12:48:47.842] Writing custom genesis block 
INFO [05-12|12:48:47.869] Persisted trie from memory database      nodes=7 size=967.00B time=3.404603ms gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|12:48:47.896] Successfully wrote genesis state         database=chaindata           hash=307166…4ad445
INFO [05-12|12:48:47.897] Allocated cache and file handles         database=/eth/geth/lightchaindata cache=16.00MiB handles=16
INFO [05-12|12:48:47.968] Writing custom genesis block 
INFO [05-12|12:48:47.971] Persisted trie from memory database      nodes=7 size=967.00B time=2.510859ms gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|12:48:47.995] Successfully wrote genesis state         database=lightchaindata           hash=307166…4ad445
WARN [05-12|12:48:48.092] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
WARN [05-12|12:48:48.110] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
WARN [05-12|12:48:48.125] Sanitizing invalid miner gas price       provided=0 updated=0
WARN [05-12|12:48:48.278] Upgrade blockchain database version      from=<nil> to=7
WARN [05-12|12:48:48.860] Fast syncing, discarded propagated block number=1 hash=6040da…1809d5
WARN [05-12|12:48:48.880] Fast syncing, discarded propagated block number=1 hash=6040da…1809d5
/run.sh: geth Running.
INFO [2022-05-12 12:48:49,354|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=0, latest=2
INFO [2022-05-12 12:49:19,340|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=2, latest=32
INFO [2022-05-12 12:49:49,347|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=32, latest=62
INFO [2022-05-12 12:50:19,355|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=62, latest=92
INFO [2022-05-12 12:50:49,363|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=92, latest=122
INFO [2022-05-12 12:51:19,363|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=122, latest=152
INFO [2022-05-12 12:51:49,366|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=152, latest=182
INFO [2022-05-12 12:52:19,374|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=182, latest=212
/run.sh: geth Shutdown.

ここで Validatorノードのみを v21.1→v22.1 に変更すると、以下のようにブロック同期が失敗する結果が得られる。

WARN [05-12|12:52:35.410] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
WARN [05-12|12:52:35.416] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
WARN [05-12|12:52:35.420] Sanitizing invalid miner gas price       provided=0 updated=0
WARN [05-12|12:52:35.652] Switch sync mode from fast sync to full sync 
INFO [2022-05-12 12:52:36,164|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=0, latest=216
/run.sh: geth Running.
ERROR [2022-05-12 12:53:06,162|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=216, latest=216
INFO [05-12|12:52:35.116] Maximum peer count                       ETH=50 LES=0 total=50
INFO [05-12|12:52:35.116] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
WARN [05-12|12:52:35.120] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
INFO [05-12|12:52:35.121] Allocated cache and file handles         database=/eth/geth/chaindata cache=16.00MiB handles=16
INFO [05-12|12:52:35.252] Persisted trie from memory database      nodes=7 size=967.00B time=38.626µs gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|12:52:35.255] Successfully wrote genesis state         database=chaindata           hash=307166…4ad445
INFO [05-12|12:52:35.256] Allocated cache and file handles         database=/eth/geth/lightchaindata cache=16.00MiB handles=16
INFO [05-12|12:52:35.289] Persisted trie from memory database      nodes=7 size=967.00B time=18.828µs gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|12:52:35.290] Successfully wrote genesis state         database=lightchaindata           hash=307166…4ad445
ERROR [2022-05-12 12:53:36,142|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=216, latest=216　★
WARN [05-12|12:53:45.739] Synchronisation failed, dropping peer    peer=81a7723709e695d8 err=timeout
ERROR [2022-05-12 12:54:06,136|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=216, latest=216　★

2. Generalノードもバージョンアップ

ここからさらに、Generalノードのバージョンアップを行うと、以下のような状態になる。

INFO [05-12|13:06:10.336] Running with private transaction manager disabled - quorum private transactions will not be supported 
INFO [05-12|13:06:10.337] Maximum peer count                       ETH=50 LES=0 total=50
INFO [05-12|13:06:10.337] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
WARN [05-12|13:06:10.353] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
INFO [05-12|13:06:10.360] Enabling recording of key preimages since archive mode is used 
INFO [05-12|13:06:10.360] Set global gas cap                       cap=25000000
INFO [05-12|13:06:10.361] Allocated cache and file handles         database=/eth/geth/chaindata cache=16.00MiB handles=16
INFO [05-12|13:06:10.437] Persisted trie from memory database      nodes=7 size=965.00B time="31.941µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|13:06:10.554] Successfully wrote genesis state         database=chaindata           hash="307166…4ad445"
INFO [05-12|13:06:10.554] Allocated cache and file handles         database=/eth/geth/lightchaindata cache=16.00MiB handles=16
INFO [05-12|13:06:10.704] Persisted trie from memory database      nodes=7 size=965.00B time="101.854µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|13:06:10.717] Successfully wrote genesis state         database=lightchaindata           hash="307166…4ad445"
WARN [05-12|13:06:10.828] Option nousb is deprecated and USB is deactivated by default. Use --usb to enable 
WARN [05-12|13:06:10.832] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
WARN [05-12|13:06:10.835] Sanitizing invalid miner gas price       provided=0 updated=0
WARN [05-12|13:06:10.971] Upgrade blockchain database version      from=7 to=8
WARN [05-12|13:06:11.025] Failed to load snapshot, regenerating    err="missing or corrupted snapshot"
WARN [05-12|13:06:11.039] Switch sync mode from fast sync to full sync 
WARN [05-12|13:06:11.042] Error reading unclean shutdown markers   error="leveldb: not found"
WARN [05-12|13:06:11.046] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
WARN [05-12|13:06:11.126] full p2p peer                            id=81a7723709e695d859336c8d03ee8c85944b16dfa517cb0ddefe123c7341a534 ethPeer="Peer 81a7723709e695d8 172.16.239.11:30303"
WARN [05-12|13:06:11.144] full p2p peer                            id=5b0c2e93e76db53c314bb7f235d56a7515e824be4122f033d60063d035573a0c ethPeer="Peer 5b0c2e93e76db53c 172.16.239.12:30303"
INFO [2022-05-12 13:06:11,471|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=0, latest=216
/run.sh: geth Running.
WARN [05-12|13:06:17.127] full p2p peer                            id=102635096c3ebf17d46ee700c25d04978fd86ee604feb88f3c635d555eb6d42d ethPeer="Peer 102635096c3ebf17 172.16.239.13:30303"
WARN [05-12|13:06:17.128] full p2p peer                            id=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 ethPeer="Peer 336fcbbd0e44ddb9 172.16.239.10:30303"
WARN [05-12|13:06:27.232] Header broke chain ordering              number=549 hash="548022…edf854" expected=547
WARN [05-12|13:06:27.233] Synchronisation failed, dropping peer    peer=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 err="action from bad peer ignored: stale headers"
ERROR[05-12|13:06:27.233] Ethereum peer removal failed             peer=336fcbbd err="peer not registered"
INFO [2022-05-12 13:06:41,450|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=216, latest=565
WARN [05-12|13:06:46.101] full p2p peer                            id=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 ethPeer="Peer 336fcbbd0e44ddb9 172.16.239.10:30303"
INFO [2022-05-12 13:07:11,456|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=565, latest=595
INFO [2022-05-12 13:07:41,447|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=595, latest=625
INFO [2022-05-12 13:08:11,424|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=625, latest=654

追加調査結果

詳細分析

Quorum v21.1.0 を --verbosity 5 で起動した場合のログ

INFO [05-27|00:29:35.683] Maximum peer count                       ETH=50 LES=0 total=50
INFO [05-27|00:29:35.683] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
ERROR[05-27|00:29:35.687] Failed to enumerate USB devices          hub=ledger vendor=11415 failcount=1 err="failed to initialize libusb: libusb: unknown error [code -99]"
ERROR[05-27|00:29:35.687] Failed to enumerate USB devices          hub=trezor vendor=21324 failcount=1 err="failed to initialize libusb: libusb: unknown error [code -99]"
ERROR[05-27|00:29:35.687] Failed to enumerate USB devices          hub=trezor vendor=4617  failcount=1 err="failed to initialize libusb: libusb: unknown error [code -99]"
ERROR[05-27|00:29:35.687] Failed to enumerate USB devices          hub=ledger vendor=11415 failcount=2 err="failed to initialize libusb: libusb: unknown error [code -99]"
ERROR[05-27|00:29:35.687] Failed to enumerate USB devices          hub=trezor vendor=21324 failcount=2 err="failed to initialize libusb: libusb: unknown error [code -99]"
ERROR[05-27|00:29:35.687] Failed to enumerate USB devices          hub=trezor vendor=4617  failcount=2 err="failed to initialize libusb: libusb: unknown error [code -99]"
WARN [05-27|00:29:35.688] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
INFO [05-27|00:29:35.689] Allocated cache and file handles         database=/eth/geth/chaindata cache=16.00MiB handles=16
INFO [05-27|00:29:35.754] Persisted trie from memory database      nodes=7 size=967.00B time=50.434µs gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-27|00:29:35.759] Successfully wrote genesis state         database=chaindata           hash=307166…4ad445
INFO [05-27|00:29:35.759] Allocated cache and file handles         database=/eth/geth/lightchaindata cache=16.00MiB handles=16
INFO [05-27|00:29:35.849] Persisted trie from memory database      nodes=7 size=967.00B time=21.996µs gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-27|00:29:35.853] Successfully wrote genesis state         database=lightchaindata           hash=307166…4ad445
DEBUG[05-27|00:29:35.977] Sanitizing Go's GC trigger               percent=100
INFO [05-27|00:29:35.979] Maximum peer count                       ETH=50 LES=0 total=50
INFO [05-27|00:29:35.979] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
TRACE[05-27|00:29:35.986] Started watching keystore folder         path=/eth/keystore
DEBUG[05-27|00:29:35.987] FS scan times                            list=813.218µs set=2.023µs diff=1.701µs
WARN [05-27|00:29:35.989] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
WARN [05-27|00:29:36.007] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
INFO [05-27|00:29:36.016] Starting peer-to-peer node               instance=Geth/general-0/v1.9.7-stable-a21e1d44(quorum-v21.1.0)/linux-amd64/go1.15.15
INFO [05-27|00:29:36.016] Allocated trie memory caches             clean=256.00MiB dirty=256.00MiB
INFO [05-27|00:29:36.019] Allocated cache and file handles         database=/eth/geth/chaindata cache=768.00MiB handles=524288
DEBUG[05-27|00:29:36.120] Chain freezer table opened               database=/eth/geth/chaindata/ancient table=diffs items=0 size=0.00B
DEBUG[05-27|00:29:36.127] Chain freezer table opened               database=/eth/geth/chaindata/ancient table=headers items=0 size=0.00B
DEBUG[05-27|00:29:36.136] Chain freezer table opened               database=/eth/geth/chaindata/ancient table=hashes  items=0 size=0.00B
DEBUG[05-27|00:29:36.143] Chain freezer table opened               database=/eth/geth/chaindata/ancient table=bodies  items=0 size=0.00B
DEBUG[05-27|00:29:36.149] Chain freezer table opened               database=/eth/geth/chaindata/ancient table=receipts items=0 size=0.00B
INFO [05-27|00:29:36.150] Opened ancient database                  database=/eth/geth/chaindata/ancient
DEBUG[05-27|00:29:36.152] Account Extra Data root                  hash=000000…000000
DEBUG[05-27|00:29:36.152] Current full block not old enough        number=0 hash=307166…4ad445 delay=3162240
INFO [05-27|00:29:36.154] Initialised chain configuration          config="{ChainID: 2017 Homestead: 1 DAO: <nil> DAOSupport: false EIP150: 2 EIP155: 3 EIP158: 3 Byzantium: 3 IsQuorum: true Constantinople: <nil> TransactionSizeLimit: 0 MaxCodeSize: 0 Petersburg: <nil> Istanbul: <nil> PrivacyEnhancements: <nil> Engine: istanbul}"
INFO [05-27|00:29:36.159] Initialising Ethereum protocol           name=istanbul versions="[99 64]" network=2017 dbversion=7
DEBUG[05-27|00:29:36.191] Account Extra Data root                  hash=000000…000000
DEBUG[05-27|00:29:36.191] Account Extra Data root                  hash=000000…000000
INFO [05-27|00:29:36.196] Loaded most recent local header          number=0 hash=307166…4ad445 td=1 age=4y1mo4w
INFO [05-27|00:29:36.196] Loaded most recent local full block      number=0 hash=307166…4ad445 td=1 age=4y1mo4w
INFO [05-27|00:29:36.196] Loaded most recent local fast block      number=0 hash=307166…4ad445 td=1 age=4y1mo4w
DEBUG[05-27|00:29:36.196] Account Extra Data root                  hash=000000…000000
DEBUG[05-27|00:29:36.196] Account Extra Data root                  hash=000000…000000
DEBUG[05-27|00:29:36.196] Reinjecting stale transactions           count=0
INFO [05-27|00:29:36.199] Loaded local transaction journal         transactions=0 dropped=0
INFO [05-27|00:29:36.205] Regenerated local transaction journal    transactions=0 accounts=0
INFO [05-27|00:29:36.214] Allocated fast sync bloom                size=512.00MiB
DEBUG[05-27|00:29:36.215] Recalculated downloader QoS values       rtt=20s confidence=1.000 ttl=1m0s
INFO [05-27|00:29:36.220] Initialized fast sync bloom              items=7 errorrate=0.000 elapsed=5.216ms
TRACE[05-27|00:29:36.222] Loaded voting snapshot form disk         number=0 hash=307166…4ad445
DEBUG[05-27|00:29:36.222] Account Extra Data root                  hash=000000…000000
DEBUG[05-27|00:29:36.222] Account Extra Data root                  hash=000000…000000
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=admin
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=admin
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=debug
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=web3
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.283] TCP listener up                          addr=[::]:30303
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=txpool
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=debug
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=debug
DEBUG[05-27|00:29:36.283] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=personal
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=istanbul
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=miner
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=eth
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=admin
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=debug
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=debug
DEBUG[05-27|00:29:36.284] InProc registered                        namespace=net
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=admin
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=admin
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=debug
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=web3
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=txpool
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=debug
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=debug
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=personal
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=istanbul
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=miner
DEBUG[05-27|00:29:36.284] IPC registered                           namespace=eth
DEBUG[05-27|00:29:36.285] IPC registered                           namespace=admin
DEBUG[05-27|00:29:36.285] IPC registered                           namespace=debug
DEBUG[05-27|00:29:36.285] IPC registered                           namespace=debug
DEBUG[05-27|00:29:36.285] IPC registered                           namespace=net
INFO [05-27|00:29:36.287] New local node record                    seq=2 id=130c6571a01d63b2 ip=127.0.0.1 udp=0 tcp=30303
INFO [05-27|00:29:36.287] Started P2P networking                   self="enode://f55925cdf44820a6628e9df3134ad299e3232deca7d1711403d5c00f30082cf0ef04ded15e3af2d09171b6f133a2c8a27d1ae1610afab15a7b6d1b4722da1dcc@127.0.0.1:30303?discport=0"
TRACE[05-27|00:29:36.287] New dial task                            task="staticdial 102635096c3ebf17 172.16.239.13:30303"
TRACE[05-27|00:29:36.288] New dial task                            task="staticdial 336fcbbd0e44ddb9 172.16.239.10:30303"
TRACE[05-27|00:29:36.288] New dial task                            task="staticdial 81a7723709e695d8 172.16.239.11:30303"
TRACE[05-27|00:29:36.288] New dial task                            task="staticdial 5b0c2e93e76db53c 172.16.239.12:30303"
TRACE[05-27|00:29:36.289] Dial error                               task="staticdial 336fcbbd0e44ddb9 172.16.239.10:30303" err="dial tcp 172.16.239.10:30303: connect: connection refused"
DEBUG[05-27|00:29:36.289] Can't resolve node                       id=336fcbbd0e44ddb9 err="discovery is disabled"
TRACE[05-27|00:29:36.289] Dial task done                           task="staticdial 336fcbbd0e44ddb9 172.16.239.10:30303"
TRACE[05-27|00:29:36.289] Dial error                               task="staticdial 81a7723709e695d8 172.16.239.11:30303" err="dial tcp 172.16.239.11:30303: connect: connection refused"
DEBUG[05-27|00:29:36.289] Can't resolve node                       id=81a7723709e695d8 err="discovery is disabled"
TRACE[05-27|00:29:36.289] Dial task done                           task="staticdial 81a7723709e695d8 172.16.239.11:30303"
TRACE[05-27|00:29:36.289] Dial error                               task="staticdial 102635096c3ebf17 172.16.239.13:30303" err="dial tcp 172.16.239.13:30303: connect: connection refused"
DEBUG[05-27|00:29:36.289] Can't resolve node                       id=102635096c3ebf17 err="discovery is disabled"
TRACE[05-27|00:29:36.289] Dial task done                           task="staticdial 102635096c3ebf17 172.16.239.13:30303"
TRACE[05-27|00:29:36.289] Dial error                               task="staticdial 5b0c2e93e76db53c 172.16.239.12:30303" err="dial tcp 172.16.239.12:30303: connect: connection refused"
DEBUG[05-27|00:29:36.290] Can't resolve node                       id=5b0c2e93e76db53c err="discovery is disabled"
TRACE[05-27|00:29:36.290] Dial task done                           task="staticdial 5b0c2e93e76db53c 172.16.239.12:30303"
TRACE[05-27|00:29:36.290] New dial task                            task="wait for dial hist expire (34.999089197s)"
INFO [05-27|00:29:36.296] IPC endpoint opened                      url=/eth/geth.ipc
INFO [05-27|00:29:36.296] Security Plugin is not enabled 
DEBUG[05-27|00:29:36.296] HTTP registered                          namespace=admin
DEBUG[05-27|00:29:36.296] HTTP registered                          namespace=admin
DEBUG[05-27|00:29:36.296] HTTP registered                          namespace=debug
DEBUG[05-27|00:29:36.296] HTTP registered                          namespace=web3
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=txpool
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=debug
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=debug
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=personal
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=istanbul
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=eth
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=admin
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=debug
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=debug
DEBUG[05-27|00:29:36.297] HTTP registered                          namespace=net
INFO [05-27|00:29:36.297] Security: TLS not enabled                endpoint=0.0.0.0:8545 reason="no TLSConfigurationSource found"
INFO [05-27|00:29:36.297] http endpoint opened                     url=http://0.0.0.0:8545 cors=* vhosts=*
DEBUG[05-27|00:29:36.623] Enrich call context with token from security context conn=127.0.0.1:45802
DEBUG[05-27|00:29:36.623] Served eth_blockNumber                   conn=127.0.0.1:45802 reqid=0 t=64.314µs
ERROR [2022-05-27 00:29:36,625|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=0, latest=0
/run.sh: geth Running.
DEBUG[05-27|00:29:38.361] Couldn't add port mapping                proto=tcp extport=30303 intport=30303 interface="UPnP or NAT-PMP" err="no UPnP or NAT-PMP router discovered"
DEBUG[05-27|00:29:56.194] Recalculated downloader QoS values       rtt=20s confidence=1.000 ttl=1m0s
DEBUG[05-27|00:30:06.630] Enrich call context with token from security context conn=127.0.0.1:45802
DEBUG[05-27|00:30:06.630] Served eth_blockNumber                   conn=127.0.0.1:45802 reqid=1 t=142.887µs
ERROR [2022-05-27 00:30:06,633|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=0, latest=0
TRACE[05-27|00:30:11.246] Dial task done                           task="wait for dial hist expire (34.999089197s)"
TRACE[05-27|00:30:11.246] New dial task                            task="staticdial 336fcbbd0e44ddb9 172.16.239.10:30303"
TRACE[05-27|00:30:11.246] New dial task                            task="staticdial 81a7723709e695d8 172.16.239.11:30303"
TRACE[05-27|00:30:11.246] New dial task                            task="staticdial 102635096c3ebf17 172.16.239.13:30303"
TRACE[05-27|00:30:11.251] Quorum permissioning                     id=102635096c3ebf17 addr=172.16.239.13:30303 conn=staticdial      EnableNodePermission=false DataDir=/eth Current Node ID=130c6571a01d63b232530788877af2d9e64f1ebabf243afb5cd5a8dbb36c5a39 Node Name=Geth/general-0/v1.9.7-stable-a21e1d44(quorum-v21.1.0)/linux-amd64/go1.15.15 Dialed Dest="enode://f53fff2c7ed693b627d4389b92b6d94a11b91f167193a5d31320a2b35fb752f79b3aed7dcc61961bc00b397fdf8729eb797a0b28d6c538d51232164432b67f80@172.16.239.13:30303?discport=0" Connection ID=102635096c3ebf17 Connection String=102635096c3ebf17d46ee700c25d04978fd86ee604feb88f3c635d555eb6d42d
TRACE[05-27|00:30:11.251] Node Permissioning is Disabled.          id=102635096c3ebf17 addr=172.16.239.13:30303 conn=staticdial
TRACE[05-27|00:30:11.251] New dial task                            task="staticdial 5b0c2e93e76db53c 172.16.239.12:30303"
TRACE[05-27|00:30:11.251] Quorum permissioning                     id=336fcbbd0e44ddb9 addr=172.16.239.10:30303 conn=staticdial      EnableNodePermission=false DataDir=/eth Current Node ID=130c6571a01d63b232530788877af2d9e64f1ebabf243afb5cd5a8dbb36c5a39 Node Name=Geth/general-0/v1.9.7-stable-a21e1d44(quorum-v21.1.0)/linux-amd64/go1.15.15 Dialed Dest="enode://6204d2b6d844adf9dd23f47027b29b1e39b08c70b8ec05f82a8037f1676c058fe80035b42f32c649cc47347889abfe7732139b9f3f243ea91f990d2d72bb87bd@172.16.239.10:30303?discport=0" Connection ID=336fcbbd0e44ddb9 Connection String=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534
DEBUG[05-27|00:30:11.251] Adding p2p peer                          id=102635096c3ebf17 conn=staticdial      addr=172.16.239.13:30303 peers=1 name=Geth/validator-3/v1....
TRACE[05-27|00:30:11.251] Connection set up                        id=102635096c3ebf17 addr=172.16.239.13:30303 conn=staticdial      inbound=false
TRACE[05-27|00:30:11.251] Dial task done                           task="staticdial 102635096c3ebf17 172.16.239.13:30303"
TRACE[05-27|00:30:11.251] Quorum permissioning                     id=81a7723709e695d8 addr=172.16.239.11:30303 conn=staticdial      EnableNodePermission=false DataDir=/eth Current Node ID=130c6571a01d63b232530788877af2d9e64f1ebabf243afb5cd5a8dbb36c5a39 Node Name=Geth/general-0/v1.9.7-stable-a21e1d44(quorum-v21.1.0)/linux-amd64/go1.15.15 Dialed Dest="enode://a573feff0859205b566385aaf85f4c858dfe4ebb07ec862a2d03e117b3e39d8220aaf1d58750440ad844ddcb623f6becc9ba07fc27db4d30cdf689f15a9b1462@172.16.239.11:30303?discport=0" Connection ID=81a7723709e695d8 Connection String=81a7723709e695d859336c8d03ee8c85944b16dfa517cb0ddefe123c7341a534
TRACE[05-27|00:30:11.252] Node Permissioning is Disabled.          id=81a7723709e695d8 addr=172.16.239.11:30303 conn=staticdial
TRACE[05-27|00:30:11.251] Node Permissioning is Disabled.          id=336fcbbd0e44ddb9 addr=172.16.239.10:30303 conn=staticdial
DEBUG[05-27|00:30:11.252] Adding p2p peer                          id=81a7723709e695d8 conn=staticdial      addr=172.16.239.11:30303 peers=2 name=Geth/validator-1/v1....
TRACE[05-27|00:30:11.252] Connection set up                        id=81a7723709e695d8 addr=172.16.239.11:30303 conn=staticdial      inbound=false
TRACE[05-27|00:30:11.252] Dial task done                           task="staticdial 81a7723709e695d8 172.16.239.11:30303"
TRACE[05-27|00:30:11.252] Starting protocol istanbul/99            id=81a7723709e695d8 conn=staticdial
TRACE[05-27|00:30:11.251] Starting protocol istanbul/99            id=102635096c3ebf17 conn=staticdial
DEBUG[05-27|00:30:11.252] Adding p2p peer                          id=336fcbbd0e44ddb9 conn=staticdial      addr=172.16.239.10:30303 peers=3 name=Geth/validator-0/v1....
TRACE[05-27|00:30:11.252] Connection set up                        id=336fcbbd0e44ddb9 addr=172.16.239.10:30303 conn=staticdial      inbound=false
TRACE[05-27|00:30:11.252] Dial task done                           task="staticdial 336fcbbd0e44ddb9 172.16.239.10:30303"
TRACE[05-27|00:30:11.252] Starting protocol istanbul/99            id=336fcbbd0e44ddb9 conn=staticdial
DEBUG[05-27|00:30:11.252] Ethereum peer connected                  id=81a7723709e695d8 conn=staticdial      name=Geth/validator-1/v1.10.0-stable-e890e0c1(quorum-v22.1.1)/linux-amd64/go1.16.15
DEBUG[05-27|00:30:11.252] Ethereum peer connected                  id=336fcbbd0e44ddb9 conn=staticdial      name=Geth/validator-0/v1.10.0-stable-e890e0c1(quorum-v22.1.1)/linux-amd64/go1.16.15
TRACE[05-27|00:30:11.253] Registering sync peer                    peer=81a7723709e695d8
TRACE[05-27|00:30:11.253] Registering sync peer                    peer=336fcbbd0e44ddb9
DEBUG[05-27|00:30:11.253] Relaxed downloader QoS values            rtt=20s confidence=0.500 ttl=1m0s
DEBUG[05-27|00:30:11.252] Ethereum peer connected                  id=102635096c3ebf17 conn=staticdial      name=Geth/validator-3/v1.10.0-stable-e890e0c1(quorum-v22.1.1)/linux-amd64/go1.16.15
TRACE[05-27|00:30:11.254] Quorum permissioning                     id=5b0c2e93e76db53c addr=172.16.239.12:30303 conn=staticdial      EnableNodePermission=false DataDir=/eth Current Node ID=130c6571a01d63b232530788877af2d9e64f1ebabf243afb5cd5a8dbb36c5a39 Node Name=Geth/general-0/v1.9.7-stable-a21e1d44(quorum-v21.1.0)/linux-amd64/go1.15.15 Dialed Dest="enode://76b750a2a0c92d2411e4793c714a85cf01e527c7a77f70548e7f363feaf8320039cd0f2eb48235c022d39df44ec06c96060f5c25caeec8a1960a356ebd5473a1@172.16.239.12:30303?discport=0" Connection ID=5b0c2e93e76db53c Connection String=5b0c2e93e76db53c314bb7f235d56a7515e824be4122f033d60063d035573a0c
TRACE[05-27|00:30:11.254] Node Permissioning is Disabled.          id=5b0c2e93e76db53c addr=172.16.239.12:30303 conn=staticdial
TRACE[05-27|00:30:11.254] Registering sync peer                    peer=102635096c3ebf17
DEBUG[05-27|00:30:11.254] Relaxed downloader QoS values            rtt=20s confidence=0.333 ttl=1m0s
DEBUG[05-27|00:30:11.254] Adding p2p peer                          id=5b0c2e93e76db53c conn=staticdial      addr=172.16.239.12:30303 peers=4 name=Geth/validator-2/v1....
TRACE[05-27|00:30:11.254] Connection set up                        id=5b0c2e93e76db53c addr=172.16.239.12:30303 conn=staticdial      inbound=false
TRACE[05-27|00:30:11.254] Dial task done                           task="staticdial 5b0c2e93e76db53c 172.16.239.12:30303"
TRACE[05-27|00:30:11.254] New dial task                            task="wait for dial hist expire (34.996876911s)"
TRACE[05-27|00:30:11.254] Starting protocol istanbul/99            id=5b0c2e93e76db53c conn=staticdial
DEBUG[05-27|00:30:11.255] Ethereum peer connected                  id=5b0c2e93e76db53c conn=staticdial      name=Geth/validator-2/v1.10.0-stable-e890e0c1(quorum-v22.1.1)/linux-amd64/go1.16.15
TRACE[05-27|00:30:11.256] Registering sync peer                    peer=5b0c2e93e76db53c
DEBUG[05-27|00:30:11.256] Relaxed downloader QoS values            rtt=20s confidence=0.250 ttl=1m0s
DEBUG[05-27|00:30:12.007] Discarded propagated block, too far away peer=81a7723709e695d8 number=5711 hash=ca473f…1a492d distance=5711
DEBUG[05-27|00:30:12.007] Discarded propagated block, too far away peer=336fcbbd0e44ddb9 number=5711 hash=ca473f…1a492d distance=5711
DEBUG[05-27|00:30:12.010] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5711 hash=ca473f…1a492d distance=5711
DEBUG[05-27|00:30:12.013] Discarded propagated block, too far away peer=102635096c3ebf17 number=5711 hash=ca473f…1a492d distance=5711
INFO [05-27|00:30:13.005] Block synchronisation started 
DEBUG[05-27|00:30:13.005] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5712 hash=2d3652…8526d3 distance=5712
DEBUG[05-27|00:30:13.005] Synchronising with the network           peer=5b0c2e93e76db53c eth=99 head=ca473f…1a492d td=5712 mode=fast
DEBUG[05-27|00:30:13.006] Retrieving remote chain height           peer=5b0c2e93e76db53c
DEBUG[05-27|00:30:13.006] Fetching batch of headers                id=5b0c2e93e76db53c conn=staticdial      count=1 fromhash=ca473f…1a492d skip=0 reverse=false
DEBUG[05-27|00:30:13.007] Peer discarded announcement              peer=81a7723709e695d8 number=5712 hash=2d3652…8526d3 distance=5712
DEBUG[05-27|00:30:13.008] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5712 hash=2d3652…8526d3 distance=5712
DEBUG[05-27|00:30:13.009] Peer discarded announcement              peer=102635096c3ebf17 number=5712 hash=2d3652…8526d3 distance=5712
DEBUG[05-27|00:30:14.010] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5713 hash=4e4718…7f21f6 distance=5713
DEBUG[05-27|00:30:14.011] Peer discarded announcement              peer=81a7723709e695d8 number=5713 hash=4e4718…7f21f6 distance=5713
DEBUG[05-27|00:30:14.013] Peer discarded announcement              peer=102635096c3ebf17 number=5713 hash=4e4718…7f21f6 distance=5713
DEBUG[05-27|00:30:14.013] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5713 hash=4e4718…7f21f6 distance=5713
DEBUG[05-27|00:30:15.011] Discarded propagated block, too far away peer=102635096c3ebf17 number=5714 hash=7c14e4…756feb distance=5714
DEBUG[05-27|00:30:15.012] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5714 hash=7c14e4…756feb distance=5714
DEBUG[05-27|00:30:15.013] Peer discarded announcement              peer=5b0c2e93e76db53c number=5714 hash=7c14e4…756feb distance=5714
DEBUG[05-27|00:30:15.016] Peer discarded announcement              peer=81a7723709e695d8 number=5714 hash=7c14e4…756feb distance=5714
DEBUG[05-27|00:30:16.009] Discarded propagated block, too far away peer=336fcbbd0e44ddb9 number=5715 hash=4aace8…04c770 distance=5715
DEBUG[05-27|00:30:16.010] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5715 hash=4aace8…04c770 distance=5715
DEBUG[05-27|00:30:16.011] Discarded propagated block, too far away peer=102635096c3ebf17 number=5715 hash=4aace8…04c770 distance=5715
DEBUG[05-27|00:30:16.012] Discarded propagated block, too far away peer=81a7723709e695d8 number=5715 hash=4aace8…04c770 distance=5715
DEBUG[05-27|00:30:16.172] Recalculated downloader QoS values       rtt=20s confidence=0.625 ttl=1m0s
DEBUG[05-27|00:30:17.008] Discarded propagated block, too far away peer=102635096c3ebf17 number=5716 hash=2be885…66ca8b distance=5716
DEBUG[05-27|00:30:17.011] Peer discarded announcement              peer=81a7723709e695d8 number=5716 hash=2be885…66ca8b distance=5716
DEBUG[05-27|00:30:17.012] Peer discarded announcement              peer=5b0c2e93e76db53c number=5716 hash=2be885…66ca8b distance=5716
DEBUG[05-27|00:30:17.013] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5716 hash=2be885…66ca8b distance=5716
DEBUG[05-27|00:30:18.012] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5717 hash=55461f…18e738 distance=5717
DEBUG[05-27|00:30:18.012] Peer discarded announcement              peer=81a7723709e695d8 number=5717 hash=55461f…18e738 distance=5717
DEBUG[05-27|00:30:18.013] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5717 hash=55461f…18e738 distance=5717
DEBUG[05-27|00:30:18.015] Peer discarded announcement              peer=102635096c3ebf17 number=5717 hash=55461f…18e738 distance=5717
DEBUG[05-27|00:30:19.011] Discarded propagated block, too far away peer=336fcbbd0e44ddb9 number=5718 hash=7e3bb2…7d1000 distance=5718
DEBUG[05-27|00:30:19.015] Peer discarded announcement              peer=102635096c3ebf17 number=5718 hash=7e3bb2…7d1000 distance=5718
DEBUG[05-27|00:30:19.015] Peer discarded announcement              peer=81a7723709e695d8 number=5718 hash=7e3bb2…7d1000 distance=5718
DEBUG[05-27|00:30:19.015] Peer discarded announcement              peer=5b0c2e93e76db53c number=5718 hash=7e3bb2…7d1000 distance=5718
DEBUG[05-27|00:30:20.009] Peer discarded announcement              peer=102635096c3ebf17 number=5719 hash=85fece…fff88b distance=5719
DEBUG[05-27|00:30:20.011] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5719 hash=85fece…fff88b distance=5719
DEBUG[05-27|00:30:20.013] Peer discarded announcement              peer=81a7723709e695d8 number=5719 hash=85fece…fff88b distance=5719
DEBUG[05-27|00:30:20.013] Peer discarded announcement              peer=5b0c2e93e76db53c number=5719 hash=85fece…fff88b distance=5719
DEBUG[05-27|00:30:21.006] Discarded propagated block, too far away peer=336fcbbd0e44ddb9 number=5720 hash=c4573f…19d08c distance=5720
DEBUG[05-27|00:30:21.008] Discarded propagated block, too far away peer=102635096c3ebf17 number=5720 hash=c4573f…19d08c distance=5720
DEBUG[05-27|00:30:21.011] Discarded propagated block, too far away peer=81a7723709e695d8 number=5720 hash=c4573f…19d08c distance=5720
DEBUG[05-27|00:30:21.014] Peer discarded announcement              peer=5b0c2e93e76db53c number=5720 hash=c4573f…19d08c distance=5720
DEBUG[05-27|00:30:22.011] Peer discarded announcement              peer=5b0c2e93e76db53c number=5721 hash=4982ed…84fb66 distance=5721
DEBUG[05-27|00:30:22.013] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5721 hash=4982ed…84fb66 distance=5721
DEBUG[05-27|00:30:22.013] Peer discarded announcement              peer=81a7723709e695d8 number=5721 hash=4982ed…84fb66 distance=5721
DEBUG[05-27|00:30:22.015] Peer discarded announcement              peer=102635096c3ebf17 number=5721 hash=4982ed…84fb66 distance=5721
DEBUG[05-27|00:30:23.008] Discarded propagated block, too far away peer=336fcbbd0e44ddb9 number=5722 hash=7a0887…569d3c distance=5722
DEBUG[05-27|00:30:23.011] Peer discarded announcement              peer=81a7723709e695d8 number=5722 hash=7a0887…569d3c distance=5722
DEBUG[05-27|00:30:23.012] Peer discarded announcement              peer=5b0c2e93e76db53c number=5722 hash=7a0887…569d3c distance=5722
DEBUG[05-27|00:30:23.012] Peer discarded announcement              peer=102635096c3ebf17 number=5722 hash=7a0887…569d3c distance=5722
DEBUG[05-27|00:30:24.008] Peer discarded announcement              peer=102635096c3ebf17 number=5723 hash=b02559…8c22d8 distance=5723
DEBUG[05-27|00:30:24.013] Peer discarded announcement              peer=5b0c2e93e76db53c number=5723 hash=b02559…8c22d8 distance=5723
DEBUG[05-27|00:30:24.013] Peer discarded announcement              peer=81a7723709e695d8 number=5723 hash=b02559…8c22d8 distance=5723
DEBUG[05-27|00:30:24.014] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5723 hash=b02559…8c22d8 distance=5723
DEBUG[05-27|00:30:25.006] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5724 hash=42fe23…ee3f72 distance=5724
DEBUG[05-27|00:30:25.009] Discarded propagated block, too far away peer=81a7723709e695d8 number=5724 hash=42fe23…ee3f72 distance=5724
DEBUG[05-27|00:30:25.011] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5724 hash=42fe23…ee3f72 distance=5724
DEBUG[05-27|00:30:25.011] Peer discarded announcement              peer=102635096c3ebf17 number=5724 hash=42fe23…ee3f72 distance=5724
DEBUG[05-27|00:30:26.011] Discarded propagated block, too far away peer=81a7723709e695d8 number=5725 hash=92d377…341367 distance=5725
DEBUG[05-27|00:30:26.012] Discarded propagated block, too far away peer=5b0c2e93e76db53c number=5725 hash=92d377…341367 distance=5725
DEBUG[05-27|00:30:26.017] Peer discarded announcement              peer=102635096c3ebf17 number=5725 hash=92d377…341367 distance=5725
DEBUG[05-27|00:30:26.017] Peer discarded announcement              peer=336fcbbd0e44ddb9 number=5725 hash=92d377…341367 distance=5725
/run.sh: geth Shutdown.
INFO [05-27|00:30:26.844] Got interrupt, shutting down... 
INFO [05-27|00:30:26.845] http endpoint closed                     url=http://0.0.0.0:8545
DEBUG[05-27|00:30:26.845] RPC server shutting down 
INFO [05-27|00:30:26.846] IPC endpoint closed                      url=/eth/geth.ipc
DEBUG[05-27|00:30:26.846] RPC server shutting down 
INFO [05-27|00:30:26.846] Blockchain manager stopped 
INFO [05-27|00:30:26.846] Stopping Ethereum protocol 
DEBUG[05-27|00:30:26.846] Reset ancient limit to zero 
DEBUG[05-27|00:30:26.846] Synchronisation terminated               elapsed=13.840s
DEBUG[05-27|00:30:26.846] Reset ancient limit to zero 
DEBUG[05-27|00:30:26.846] Ethereum message handling failed         id=5b0c2e93e76db53c conn=staticdial      err=EOF
DEBUG[05-27|00:30:26.846] Removing Ethereum peer                   peer=5b0c2e93e76db53c
TRACE[05-27|00:30:26.846] Unregistering sync peer                  peer=5b0c2e93e76db53c
DEBUG[05-27|00:30:26.846] Ethereum message handling failed         id=336fcbbd0e44ddb9 conn=staticdial      err=EOF
DEBUG[05-27|00:30:26.846] Removing Ethereum peer                   peer=336fcbbd0e44ddb9
TRACE[05-27|00:30:26.846] Unregistering sync peer                  peer=336fcbbd0e44ddb9
DEBUG[05-27|00:30:26.846] Ethereum message handling failed         id=81a7723709e695d8 conn=staticdial      err=EOF
DEBUG[05-27|00:30:26.846] Ethereum message handling failed         id=102635096c3ebf17 conn=staticdial      err=EOF
DEBUG[05-27|00:30:26.846] Removing Ethereum peer                   peer=81a7723709e695d8
DEBUG[05-27|00:30:26.846] Removing Ethereum peer                   peer=102635096c3ebf17
TRACE[05-27|00:30:26.846] Unregistering sync peer                  peer=81a7723709e695d8
TRACE[05-27|00:30:26.846] Unregistering sync peer                  peer=102635096c3ebf17
DEBUG[05-27|00:30:26.847] Removing p2p peer                        id=5b0c2e93e76db53c conn=staticdial      addr=172.16.239.12:30303 peers=3 duration=15.592s req=false err="client quitting"
INFO [05-27|00:30:26.847] Ethereum protocol stopped 
DEBUG[05-27|00:30:26.847] Removing p2p peer                        id=336fcbbd0e44ddb9 conn=staticdial      addr=172.16.239.10:30303 peers=2 duration=15.594s req=false err="client quitting"
DEBUG[05-27|00:30:26.847] Removing p2p peer                        id=102635096c3ebf17 conn=staticdial      addr=172.16.239.13:30303 peers=1 duration=15.595s req=false err="client quitting"
DEBUG[05-27|00:30:26.847] Removing p2p peer                        id=81a7723709e695d8 conn=staticdial      addr=172.16.239.11:30303 peers=0 duration=15.595s req=false err="client quitting"
INFO [05-27|00:30:26.847] Transaction pool stopped 
DEBUG[05-27|00:30:26.850] Read error                               err="accept tcp [::]:30303: use of closed network connection"
DEBUG[05-27|00:30:26.850] Deleting port mapping                    proto=tcp extport=30303 intport=30303 interface="UPnP or NAT-PMP"
TRACE[05-27|00:30:26.850] P2P networking is spinning down ​
YoshihitoAso commented 2 years ago

Quorum v21.1 -> v22.1 移行調査結果（その２）

Generalノードの genesis.json の切り替えに関する検証

"istanbul": {
    "epoch": 30000,
    "policy": 0,
    "testQBFTBlock": 90000
}

Generalノード側のgenesis.jsonに対して、testQBFTBlock の定義のありなしで検証。

1. old genesis.json（testQBFTBlockなし）

"invalid extra data format" となりブロック同期ができない状態になる。

INFO [05-12|03:53:09.701] Running with private transaction manager disabled - quorum private transactions will not be supported 
INFO [05-12|03:53:09.703] Maximum peer count ETH=50 LES=0 total=50
INFO [05-12|03:53:09.703] Smartcard socket not found, disabling err="stat /run/pcscd/pcscd.comm: no such file or directory"
WARN [05-12|03:53:09.709] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
INFO [05-12|03:53:09.713] Enabling recording of key preimages since archive mode is used 
INFO [05-12|03:53:09.713] Set global gas cap cap=25000000
INFO [05-12|03:53:09.713] Allocated cache and file handles database=/eth/geth/chaindata cache=16.00MiB handles=16
INFO [05-12|03:53:26.140] Persisted trie from memory database nodes=7 size=965.00B time="25.289µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|03:53:26.643] Successfully wrote genesis state database=chaindata hash="307166…4ad445"
INFO [05-12|03:53:26.644] Allocated cache and file handles database=/eth/geth/lightchaindata cache=16.00MiB handles=16
INFO [05-12|03:53:26.674] Persisted trie from memory database nodes=7 size=965.00B time="20.887µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|03:53:26.676] Successfully wrote genesis state database=lightchaindata hash="307166…4ad445"
WARN [05-12|03:53:26.736] Option nousb is deprecated and USB is deactivated by default. Use --usb to enable 
WARN [05-12|03:53:26.740] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
WARN [05-12|03:53:26.742] Sanitizing invalid miner gas price provided=0 updated=0
WARN [05-12|03:53:27.100] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
WARN [05-12|03:53:27.163] full p2p peer id=102635096c3ebf17d46ee700c25d04978fd86ee604feb88f3c635d555eb6d42d ethPeer="Peer 102635096c3ebf17 172.16.239.13:30303"
WARN [05-12|03:53:27.164] full p2p peer id=5b0c2e93e76db53c314bb7f235d56a7515e824be4122f033d60063d035573a0c ethPeer="Peer 5b0c2e93e76db53c 172.16.239.12:30303"
WARN [05-12|03:53:27.164] full p2p peer id=81a7723709e695d859336c8d03ee8c85944b16dfa517cb0ddefe123c7341a534 ethPeer="Peer 81a7723709e695d8 172.16.239.11:30303"
WARN [05-12|03:53:27.164] full p2p peer id=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 ethPeer="Peer 336fcbbd0e44ddb9 172.16.239.10:30303"
ERROR [2022-05-12 03:53:27,221|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=0, latest=0
/run.sh: geth Running.
WARN [05-12|03:53:47.304] Invalid header encountered number=90000 hash="8532c3…026c04" parent="f088ce…09029c" err="invalid extra data format"
WARN [05-12|03:53:47.304] Rewinding blockchain target=87934
WARN [05-12|03:53:48.393] Rolled back chain segment header=89983->87934 fast=87935->87934 block=0->0 reason="invalid extra data format"
WARN [05-12|03:53:48.393] Synchronisation failed, dropping peer peer=102635096c3ebf17d46ee700c25d04978fd86ee604feb88f3c635d555eb6d42d err="retrieved hash chain is invalid: invalid extra data format"
ERROR[05-12|03:53:48.393] Ethereum peer removal failed peer=10263509 err="peer not registered"
ERROR [2022-05-12 03:53:57,203|MONITOR-BLOCK-SYNC] FATAL: Block number has not been increased: start=0, latest=0

2. new genesis.json（testQBFTBlockあり）

ブロック同期は成功する

INFO [05-12|03:59:38.312] Running with private transaction manager disabled - quorum private transactions will not be supported 
INFO [05-12|03:59:38.317] Maximum peer count                       ETH=50 LES=0 total=50
INFO [05-12|03:59:38.317] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
WARN [05-12|03:59:38.326] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
INFO [05-12|03:59:38.330] Enabling recording of key preimages since archive mode is used 
INFO [05-12|03:59:38.330] Set global gas cap                       cap=25000000
INFO [05-12|03:59:38.331] Allocated cache and file handles         database=/eth/geth/chaindata cache=16.00MiB handles=16
INFO [05-12|04:00:08.650] Persisted trie from memory database      nodes=7 size=965.00B time="22.561µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|04:00:10.671] Successfully wrote genesis state         database=chaindata           hash="307166…4ad445"
INFO [05-12|04:00:10.671] Allocated cache and file handles         database=/eth/geth/lightchaindata cache=16.00MiB handles=16
INFO [05-12|04:00:10.777] Persisted trie from memory database      nodes=7 size=965.00B time="21.813µs" gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
INFO [05-12|04:00:10.781] Successfully wrote genesis state         database=lightchaindata           hash="307166…4ad445"
WARN [05-12|04:00:10.875] Option nousb is deprecated and USB is deactivated by default. Use --usb to enable 
WARN [05-12|04:00:10.882] Found deprecated node list file /eth/geth/static-nodes.json, please use the TOML config file instead. 
WARN [05-12|04:00:10.888] Sanitizing invalid miner gas price       provided=0 updated=0
WARNING [2022-05-12 04:00:11,492|MONITOR-BLOCK-SYNC] Unable to connect to node
/run.sh: geth Running.
WARN [05-12|04:00:13.354] permission-config.json file is missing. Smart-contract-based permission service will be disabled error="stat /eth/permission-config.json: no such file or directory"
WARN [05-12|04:00:13.534] full p2p peer                            id=81a7723709e695d859336c8d03ee8c85944b16dfa517cb0ddefe123c7341a534 ethPeer="Peer 81a7723709e695d8 172.16.239.11:30303"
WARN [05-12|04:00:13.535] full p2p peer                            id=5b0c2e93e76db53c314bb7f235d56a7515e824be4122f033d60063d035573a0c ethPeer="Peer 5b0c2e93e76db53c 172.16.239.12:30303"
WARN [05-12|04:00:13.536] full p2p peer                            id=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 ethPeer="Peer 336fcbbd0e44ddb9 172.16.239.10:30303"
WARN [05-12|04:00:13.536] full p2p peer                            id=102635096c3ebf17d46ee700c25d04978fd86ee604feb88f3c635d555eb6d42d ethPeer="Peer 102635096c3ebf17 172.16.239.13:30303"
WARN [05-12|04:00:34.096] Invalid header encountered               number=101475 hash="764eea…420034" parent="beccf1…236373" err="unknown ancestor"
WARN [05-12|04:00:34.096] Rewinding blockchain                     target=99423
WARN [05-12|04:00:38.064] Rolled back chain segment                header=101472->99423 fast=101401->99423 block=101472->99423 reason="unknown ancestor"
WARN [05-12|04:00:38.065] Synchronisation failed, dropping peer    peer=81a7723709e695d859336c8d03ee8c85944b16dfa517cb0ddefe123c7341a534 err="retrieved hash chain is invalid: unknown ancestor"
ERROR[05-12|04:00:38.065] Ethereum peer removal failed             peer=81a77237 err="peer not registered"
INFO [2022-05-12 04:00:41,496|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=0, latest=99423
WARN [05-12|04:00:48.495] full p2p peer                            id=81a7723709e695d859336c8d03ee8c85944b16dfa517cb0ddefe123c7341a534 ethPeer="Peer 81a7723709e695d8 172.16.239.11:30303"
WARN [05-12|04:00:51.545] Invalid header encountered               number=101493 hash="f9b80c…231de5" parent="af694c…491c15" err="unknown ancestor"
WARN [05-12|04:00:51.545] Rewinding blockchain                     target=99440
WARN [05-12|04:00:53.109] Rolled back chain segment                header=101489->99440 fast=101426->99440 block=101489->99440 reason="unknown ancestor"
WARN [05-12|04:00:53.109] Synchronisation failed, dropping peer    peer=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 err="retrieved hash chain is invalid: unknown ancestor"
ERROR[05-12|04:00:53.109] Ethereum peer removal failed             peer=336fcbbd err="peer not registered"
WARN [05-12|04:00:53.113] full p2p peer                            id=336fcbbd0e44ddb950950ebb47a847fbdf801154253593851ac9a2e775323534 ethPeer="Peer 336fcbbd0e44ddb9 172.16.239.10:30303"
INFO [2022-05-12 04:01:11,506|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=99423, latest=101514
INFO [2022-05-12 04:01:41,514|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=101514, latest=101543
INFO [2022-05-12 04:02:11,497|MONITOR-BLOCK-SYNC] Blocks are successfully synchronized: start=101543, latest=101574