search

dusk-network / dusk-blockchain

Reference implementation of the DUSK Network node, written in Golang
MIT License
102 stars 47 forks source link

Investigate stake contract inconsistency #1408

Open goshawk-3 opened 2 years ago

goshawk-3 commented 2 years ago

Describe the bug Two nodes from a single devnet network reported same state_hash but different provisioners set after a successful rusk.Finalize call.

node_1 accepted a block with state_hash":"9102c6e0f6...ba694db0e8 at height 52089 with 0 provisioners removed/added

root@ureeves-20220505-node-1:~# zgrep accept_block /var/log/dusk.*.gz | grep 'curr_h":52089'

/var/log/dusk.log-20220515.gz:{"block_time":9,"cert_step":3,"curr_h":52089,"event":"accept_block","hash":"e00e7f1771...37ba1c2130","height":52090,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-10T03:55:23Z","txs_count":0}
/var/log/dusk.log-20220515.gz:{"added":0,"block_time":9,"cert_step":3,"curr_h":52089,"event":"accept_block","hash":"e00e7f1771...37ba1c2130","height":52090,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"9102c6e0f6...ba694db0e8","time":"2022-05-10T03:55:23Z","txs_count":0}

node_11 accepted a block with "state_hash":"9102c6e0f6...ba694db0e8" at height 52089 with 6 provisioners removed

root@ureeves-20220505-node-11:~# zgrep accept_block /var/log/dusk.*.gz | grep 'curr_h":52089'

/var/log/dusk.log-20220522.gz:{"block_time":9,"cert_step":3,"curr_h":52089,"event":"accept_block","hash":"e00e7f1771...37ba1c2130","height":52090,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:16Z","txs_count":0}
/var/log/dusk.log-20220522.gz:{"added":-6,"block_time":9,"cert_step":3,"curr_h":52089,"event":"accept_block","hash":"e00e7f1771...37ba1c2130","height":52090,"level":"info","msg":"state transition completed","process":"chain","prov":24,"state_hash":"9102c6e0f6...ba694db0e8","time":"2022-05-16T19:07:16Z","txs_count":0}

Expected behaviour If no explicit withdraw transaction is accepted, we should not expect any modification to Provisioners set/Stake Contract state.

goshawk-3 commented 2 years ago

Note - No transactions accepted with this block

{
    "data": {
        "blocks": [
            {
                "header": {
                    "feespaid": 0,
                    "hash": "c73d67b755b698ca5caca26ae61c47e0f4d0d345cb38e8555a2a574634ee592e",
                    "height": 52089,
                    "prevblockhash": "ff1cf4ca2bb56d0efda16db958f0b2d30be98dae3b4b28be6bd4603e9620fc92",
                    "reward": 0,
                    "statehash": "e7a23289277a6ae995cce08f1bafa311bace43724bdddcab2e02d6c2e6c8b9d0",
                    "step": 3,
                    "timestamp": "2022-05-10 03:55:11 +0000 UTC",
                    "version": "0"
                },
                "transactions": []
            }
        ]
    }
}
goshawk-3 commented 2 years ago

Rusk logs at the time of the inconsistency event.

root@ureeves-20220505-node-11:~# zcat /var/log/dusk_rusk.log-20220522.gz | grep -B 10 -A 10 '2022-05-16T19:07:16.377098Z'
2022-05-16T19:07:14.824792Z  WARN rusk::services::network: Error in dispatcher notification channel closed
2022-05-16T19:07:14.840001Z  WARN rusk::services::network: Error in dispatcher notification channel closed
2022-05-16T19:07:14.850401Z  WARN rusk::services::network: Error in dispatcher notification channel closed
2022-05-16T19:07:14.857926Z  WARN rusk::services::network: Error in dispatcher notification channel closed
2022-05-16T19:07:14.865039Z  INFO rusk::services::state: Received GetEphemeralStateRoot request
2022-05-16T19:07:14.865545Z  INFO rusk::services::state: Received Finalize request
2022-05-16T19:07:14.883344Z  INFO rusk::services::state: Received GetProvisioners request
2022-05-16T19:07:14.968247Z  WARN rusk::services::network: Error in dispatcher notification channel closed
2022-05-16T19:07:16.356504Z  INFO rusk::services::state: Received GetEphemeralStateRoot request
2022-05-16T19:07:16.357141Z  INFO rusk::services::state: Received Finalize request
2022-05-16T19:07:16.377098Z  INFO rusk::services::state: Received GetProvisioners request
2022-05-16T20:07:04.181458Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-16T21:07:04.182790Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-16T22:07:04.184334Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-16T22:59:18.366894Z  WARN rusk::services::network: Skipped 6 message
2022-05-16T23:07:04.185484Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-17T00:07:04.186689Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-17T01:07:04.188280Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-17T02:07:04.189482Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
2022-05-17T02:37:22.054528Z  WARN rusk::services::network: Skipped 1 message
2022-05-17T03:07:04.191015Z  INFO kadcast::mantainer: TableMantainer::monitor_buckets woke up
herr-seppia commented 2 years ago

This happened after a restart and during the sync process If you look at the log /var/log/dusk.log-20220522.gz it start with block 52.000

zgrep 'curr_h":52089' /var/log/dusk.log-20220522.gz -B310

{"block_time":10,"cert_step":3,"curr_h":52000,"event":"accept_block","hash":"2ea891e456...6ed4aba33c","height":52001,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:35Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52000,"event":"accept_block","hash":"2ea891e456...6ed4aba33c","height":52001,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"6e8883e72f...c89a6deb98","time":"2022-05-16T19:06:35Z","txs_count":0}
{"height":52001,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:35Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52001,"event":"accept_block","hash":"bbaa7ecfbe...16c4b5f372","height":52002,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:36Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52001,"event":"accept_block","hash":"bbaa7ecfbe...16c4b5f372","height":52002,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"287c954c42...d8a6c5e05e","time":"2022-05-16T19:06:36Z","txs_count":0}
{"height":52002,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:36Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52002,"event":"accept_block","hash":"a9a4c4a129...50d8d39665","height":52003,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:37Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52002,"event":"accept_block","hash":"a9a4c4a129...50d8d39665","height":52003,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"9986f092c4...b46f6ac7a0","time":"2022-05-16T19:06:37Z","txs_count":0}
{"height":52003,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:37Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52003,"event":"accept_block","hash":"595b9e962f...b08a5c9f26","height":52004,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:37Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52003,"event":"accept_block","hash":"595b9e962f...b08a5c9f26","height":52004,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"ab22b76916...b2db4eca59","time":"2022-05-16T19:06:38Z","txs_count":0}
{"height":52004,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:38Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52004,"event":"accept_block","hash":"aa11241b75...f2469afef7","height":52005,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:38Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52004,"event":"accept_block","hash":"aa11241b75...f2469afef7","height":52005,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"799d12c448...d0863f2580","time":"2022-05-16T19:06:38Z","txs_count":0}
{"height":52005,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:38Z","txs_count":0}
{"block_time":8,"cert_step":3,"curr_h":52005,"event":"accept_block","hash":"85d9554f4c...b421dae15a","height":52006,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:39Z","txs_count":0}
{"added":0,"block_time":8,"cert_step":3,"curr_h":52005,"event":"accept_block","hash":"85d9554f4c...b421dae15a","height":52006,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"99049f44a8...760c935950","time":"2022-05-16T19:06:39Z","txs_count":0}
{"height":52006,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:39Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52006,"event":"accept_block","hash":"bc858ad9ea...0c565d2913","height":52007,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:39Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52006,"event":"accept_block","hash":"bc858ad9ea...0c565d2913","height":52007,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"2cb7ab1be9...8a80adc8e1","time":"2022-05-16T19:06:40Z","txs_count":0}
{"height":52007,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:40Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52007,"event":"accept_block","hash":"cbef8d7927...054af0b1ff","height":52008,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:40Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52007,"event":"accept_block","hash":"cbef8d7927...054af0b1ff","height":52008,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"1fc5cf2afe...b6bf976951","time":"2022-05-16T19:06:41Z","txs_count":0}
{"height":52008,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:41Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52008,"event":"accept_block","hash":"bfc40f194d...72462369b1","height":52009,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:41Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52008,"event":"accept_block","hash":"bfc40f194d...72462369b1","height":52009,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"754dd9abda...ef635e816b","time":"2022-05-16T19:06:42Z","txs_count":0}
{"height":52009,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:42Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52009,"event":"accept_block","hash":"b4ac1d017e...ae46d22ff7","height":52010,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:42Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52009,"event":"accept_block","hash":"b4ac1d017e...ae46d22ff7","height":52010,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"9b3a180022...a689692a97","time":"2022-05-16T19:06:43Z","txs_count":0}
{"height":52010,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:43Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52010,"event":"accept_block","hash":"018c18e624...029628850a","height":52011,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:44Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52010,"event":"accept_block","hash":"018c18e624...029628850a","height":52011,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"39f21f22f9...c817422ad7","time":"2022-05-16T19:06:44Z","txs_count":0}
{"height":52011,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:44Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52011,"event":"accept_block","hash":"6461c2d08c...478d60e2ff","height":52012,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:45Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52011,"event":"accept_block","hash":"6461c2d08c...478d60e2ff","height":52012,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"98d2a69aa6...7db60ea457","time":"2022-05-16T19:06:45Z","txs_count":0}
{"height":52012,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:45Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52012,"event":"accept_block","hash":"1f68870eba...04387a7271","height":52013,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:46Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52012,"event":"accept_block","hash":"1f68870eba...04387a7271","height":52013,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"2d875ea1f8...a28d036e13","time":"2022-05-16T19:06:47Z","txs_count":0}
{"height":52013,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:47Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52013,"event":"accept_block","hash":"dc43b6aecf...24773d9856","height":52014,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:47Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52013,"event":"accept_block","hash":"dc43b6aecf...24773d9856","height":52014,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"71d4c53cc6...f266d7df98","time":"2022-05-16T19:06:48Z","txs_count":0}
{"height":52014,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:48Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52014,"event":"accept_block","hash":"9670601841...cb3275ae47","height":52015,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:49Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52014,"event":"accept_block","hash":"9670601841...cb3275ae47","height":52015,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"60297b3e1a...69d5b0d74b","time":"2022-05-16T19:06:49Z","txs_count":0}
{"height":52015,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:49Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52015,"event":"accept_block","hash":"c06ac256a4...8789c6bcdd","height":52016,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:50Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52015,"event":"accept_block","hash":"c06ac256a4...8789c6bcdd","height":52016,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"3aba569446...5bd2aa8d04","time":"2022-05-16T19:06:50Z","txs_count":0}
{"height":52016,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:50Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52016,"event":"accept_block","hash":"212b21459a...32e7bb509b","height":52017,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:50Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52016,"event":"accept_block","hash":"212b21459a...32e7bb509b","height":52017,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"aab2cf5231...558be42c38","time":"2022-05-16T19:06:51Z","txs_count":0}
{"height":52017,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:51Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52017,"event":"accept_block","hash":"4b9118ecfa...5368d071fa","height":52018,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:51Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52017,"event":"accept_block","hash":"4b9118ecfa...5368d071fa","height":52018,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"1b90a78183...81c545e6e1","time":"2022-05-16T19:06:52Z","txs_count":0}
{"height":52018,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:52Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52018,"event":"accept_block","hash":"f277bf2bc1...1281c36c1c","height":52019,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:52Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52018,"event":"accept_block","hash":"f277bf2bc1...1281c36c1c","height":52019,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"513e6415c8...0c61c27e99","time":"2022-05-16T19:06:53Z","txs_count":0}
{"height":52019,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:53Z","txs_count":0}
{"block_time":11,"cert_step":3,"curr_h":52019,"event":"accept_block","hash":"0913554521...ece8613b73","height":52020,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:53Z","txs_count":0}
{"added":0,"block_time":11,"cert_step":3,"curr_h":52019,"event":"accept_block","hash":"0913554521...ece8613b73","height":52020,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"e25f1a03a1...1bec684be4","time":"2022-05-16T19:06:54Z","txs_count":0}
{"height":52020,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:54Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52020,"event":"accept_block","hash":"04bd3b52e5...0819e03c19","height":52021,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:54Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52020,"event":"accept_block","hash":"04bd3b52e5...0819e03c19","height":52021,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"c2620c3c00...13921e8f0b","time":"2022-05-16T19:06:54Z","txs_count":0}
{"height":52021,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:54Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52021,"event":"accept_block","hash":"7e8ad23082...3b1989525e","height":52022,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:54Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52021,"event":"accept_block","hash":"7e8ad23082...3b1989525e","height":52022,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"13d82eba57...4696fe744c","time":"2022-05-16T19:06:55Z","txs_count":0}
{"height":52022,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:55Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52022,"event":"accept_block","hash":"461e426f01...d0d16a34a3","height":52023,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:55Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52022,"event":"accept_block","hash":"461e426f01...d0d16a34a3","height":52023,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"a4ef9d7d44...94e0141568","time":"2022-05-16T19:06:55Z","txs_count":0}
{"height":52023,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:55Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52023,"event":"accept_block","hash":"bcfdbb384b...d00da0887f","height":52024,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:56Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52023,"event":"accept_block","hash":"bcfdbb384b...d00da0887f","height":52024,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"6ac4d45989...3514f8f041","time":"2022-05-16T19:06:56Z","txs_count":0}
{"height":52024,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:56Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52024,"event":"accept_block","hash":"8965725654...bde9093aa5","height":52025,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:56Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52024,"event":"accept_block","hash":"8965725654...bde9093aa5","height":52025,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"a421424728...aedf81654e","time":"2022-05-16T19:06:56Z","txs_count":0}
{"height":52025,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:56Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52025,"event":"accept_block","hash":"6786e9bbe1...f5250678fb","height":52026,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:56Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52025,"event":"accept_block","hash":"6786e9bbe1...f5250678fb","height":52026,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"64189b7ecb...8457c18fa6","time":"2022-05-16T19:06:57Z","txs_count":0}
{"height":52026,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:57Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52026,"event":"accept_block","hash":"48abea942b...afb5d5171e","height":52027,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:57Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52026,"event":"accept_block","hash":"48abea942b...afb5d5171e","height":52027,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"0cd3c42f33...327360e9ee","time":"2022-05-16T19:06:57Z","txs_count":0}
{"height":52027,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:57Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52027,"event":"accept_block","hash":"722f438b66...72a3045dd8","height":52028,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:57Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52027,"event":"accept_block","hash":"722f438b66...72a3045dd8","height":52028,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"34b501e25b...e1f0aad97e","time":"2022-05-16T19:06:57Z","txs_count":0}
{"height":52028,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:57Z","txs_count":0}
{"block_time":8,"cert_step":3,"curr_h":52028,"event":"accept_block","hash":"940e6a2a54...2dcb80a23a","height":52029,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:57Z","txs_count":0}
{"added":0,"block_time":8,"cert_step":3,"curr_h":52028,"event":"accept_block","hash":"940e6a2a54...2dcb80a23a","height":52029,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"a90b8a4c50...bcd13be2bd","time":"2022-05-16T19:06:57Z","txs_count":0}
{"height":52029,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:57Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52029,"event":"accept_block","hash":"94247ff7a7...286df86e4b","height":52030,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:57Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52029,"event":"accept_block","hash":"94247ff7a7...286df86e4b","height":52030,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"4650db2d81...6b5848a485","time":"2022-05-16T19:06:58Z","txs_count":0}
{"height":52030,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:58Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52030,"event":"accept_block","hash":"e1a9b62872...48f290ec85","height":52031,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:58Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52030,"event":"accept_block","hash":"e1a9b62872...48f290ec85","height":52031,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"1f446307a2...d577f55486","time":"2022-05-16T19:06:58Z","txs_count":0}
{"height":52031,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:58Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52031,"event":"accept_block","hash":"8c22c58158...6f189e85fe","height":52032,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:58Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52031,"event":"accept_block","hash":"8c22c58158...6f189e85fe","height":52032,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"b89bdf34e4...4ad2008981","time":"2022-05-16T19:06:58Z","txs_count":0}
{"height":52032,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:58Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52032,"event":"accept_block","hash":"a85da9b27e...243e9469f9","height":52033,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:58Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52032,"event":"accept_block","hash":"a85da9b27e...243e9469f9","height":52033,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"c7cba6dd72...2502bd6c79","time":"2022-05-16T19:06:59Z","txs_count":0}
{"height":52033,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:59Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52033,"event":"accept_block","hash":"da6e647dd7...a2397d6c81","height":52034,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:59Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52033,"event":"accept_block","hash":"da6e647dd7...a2397d6c81","height":52034,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"5461a25c37...476740f98a","time":"2022-05-16T19:06:59Z","txs_count":0}
{"height":52034,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:59Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52034,"event":"accept_block","hash":"bd84aa771a...dbe892f322","height":52035,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:59Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52034,"event":"accept_block","hash":"bd84aa771a...dbe892f322","height":52035,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"d5b5108bdb...43e845d809","time":"2022-05-16T19:06:59Z","txs_count":0}
{"height":52035,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:06:59Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52035,"event":"accept_block","hash":"afdd54d633...b36ef38a66","height":52036,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:06:59Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52035,"event":"accept_block","hash":"afdd54d633...b36ef38a66","height":52036,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"dcf347ed84...bcf5c53f30","time":"2022-05-16T19:07:00Z","txs_count":0}
{"height":52036,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:00Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52036,"event":"accept_block","hash":"be01bbe6c7...3ed7b8d8a3","height":52037,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:00Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52036,"event":"accept_block","hash":"be01bbe6c7...3ed7b8d8a3","height":52037,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"fdb4d95d29...383b4c4ecd","time":"2022-05-16T19:07:00Z","txs_count":0}
{"height":52037,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:00Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52037,"event":"accept_block","hash":"d3e5bef35a...22aa3f7f46","height":52038,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:00Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52037,"event":"accept_block","hash":"d3e5bef35a...22aa3f7f46","height":52038,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"c894504e54...7a7c0aa4d1","time":"2022-05-16T19:07:00Z","txs_count":0}
{"height":52038,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:00Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52038,"event":"accept_block","hash":"79c1356f04...554526ed62","height":52039,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:00Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52038,"event":"accept_block","hash":"79c1356f04...554526ed62","height":52039,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"e300e973e8...8d9ba739d6","time":"2022-05-16T19:07:00Z","txs_count":0}
{"height":52039,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:00Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52039,"event":"accept_block","hash":"e323bad080...4a5dc98d22","height":52040,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:00Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52039,"event":"accept_block","hash":"e323bad080...4a5dc98d22","height":52040,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"69fce7fba6...88d7ccb219","time":"2022-05-16T19:07:00Z","txs_count":0}
{"height":52040,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:00Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52040,"event":"accept_block","hash":"09bb979228...560408f185","height":52041,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:01Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52040,"event":"accept_block","hash":"09bb979228...560408f185","height":52041,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"2e9b84217e...863bddb156","time":"2022-05-16T19:07:01Z","txs_count":0}
{"height":52041,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:01Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52041,"event":"accept_block","hash":"ffa1395233...1e9db29b4c","height":52042,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:01Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52041,"event":"accept_block","hash":"ffa1395233...1e9db29b4c","height":52042,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"b9b10d4769...d486401a0b","time":"2022-05-16T19:07:01Z","txs_count":0}
{"height":52042,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:01Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52042,"event":"accept_block","hash":"ab68aa87a9...3b988c8392","height":52043,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:01Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52042,"event":"accept_block","hash":"ab68aa87a9...3b988c8392","height":52043,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"35341cea9d...84bda3096f","time":"2022-05-16T19:07:01Z","txs_count":0}
{"height":52043,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:01Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52043,"event":"accept_block","hash":"63aa6ec4c6...c1f04d9078","height":52044,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:01Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52043,"event":"accept_block","hash":"63aa6ec4c6...c1f04d9078","height":52044,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"bfb3a91f7c...bb9f445af0","time":"2022-05-16T19:07:02Z","txs_count":0}
{"height":52044,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:02Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52044,"event":"accept_block","hash":"edde72d3a4...9226045886","height":52045,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:02Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52044,"event":"accept_block","hash":"edde72d3a4...9226045886","height":52045,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"2704cb8959...4ab21c1a46","time":"2022-05-16T19:07:02Z","txs_count":0}
{"height":52045,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:02Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52045,"event":"accept_block","hash":"79201f2e48...6ee2bc4e9e","height":52046,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:02Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52045,"event":"accept_block","hash":"79201f2e48...6ee2bc4e9e","height":52046,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"606daacd38...39073b2dad","time":"2022-05-16T19:07:02Z","txs_count":0}
{"height":52046,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:02Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52046,"event":"accept_block","hash":"45c0c6fdf1...3fcbea6244","height":52047,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:02Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52046,"event":"accept_block","hash":"45c0c6fdf1...3fcbea6244","height":52047,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"cd3da2ab5b...642d7bd35f","time":"2022-05-16T19:07:02Z","txs_count":0}
{"height":52047,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:02Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52047,"event":"accept_block","hash":"754743753b...5676eab520","height":52048,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:02Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52047,"event":"accept_block","hash":"754743753b...5676eab520","height":52048,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"2d152ac6ae...3e0a617e26","time":"2022-05-16T19:07:02Z","txs_count":0}
{"height":52048,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:02Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52048,"event":"accept_block","hash":"3243d3358b...04eef3dfbe","height":52049,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:03Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52048,"event":"accept_block","hash":"3243d3358b...04eef3dfbe","height":52049,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"88fd41ccf8...a4e246e642","time":"2022-05-16T19:07:03Z","txs_count":0}
{"height":52049,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:03Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52049,"event":"accept_block","hash":"55f4949e37...4e7b26b4ef","height":52050,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:03Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52049,"event":"accept_block","hash":"55f4949e37...4e7b26b4ef","height":52050,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"44f6bacdcd...10b290fe4a","time":"2022-05-16T19:07:03Z","txs_count":0}
{"height":52050,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:03Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52050,"event":"accept_block","hash":"064b049de1...59e56228d4","height":52051,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:03Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52050,"event":"accept_block","hash":"064b049de1...59e56228d4","height":52051,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"84c749bbfe...2378a2651a","time":"2022-05-16T19:07:03Z","txs_count":0}
{"height":52051,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:03Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52051,"event":"accept_block","hash":"e3f7a7291d...05fb545ee9","height":52052,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:03Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52051,"event":"accept_block","hash":"e3f7a7291d...05fb545ee9","height":52052,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"4879d0dd37...4ff4954544","time":"2022-05-16T19:07:03Z","txs_count":0}
{"height":52052,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:03Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52052,"event":"accept_block","hash":"c35159178f...0116a23e14","height":52053,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:03Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52052,"event":"accept_block","hash":"c35159178f...0116a23e14","height":52053,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"cbbf43610f...d107751a71","time":"2022-05-16T19:07:04Z","txs_count":0}
{"height":52053,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:04Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52053,"event":"accept_block","hash":"06a16103e5...b42eba0adc","height":52054,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:04Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52053,"event":"accept_block","hash":"06a16103e5...b42eba0adc","height":52054,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"3983cf1c8d...16272f7abe","time":"2022-05-16T19:07:04Z","txs_count":0}
{"height":52054,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:04Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52054,"event":"accept_block","hash":"35c6729add...85433f5032","height":52055,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:04Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52054,"event":"accept_block","hash":"35c6729add...85433f5032","height":52055,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"7e3e5dbafb...497489b9de","time":"2022-05-16T19:07:04Z","txs_count":0}
{"height":52055,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:04Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52055,"event":"accept_block","hash":"6c88b7bce7...38f7b19206","height":52056,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:05Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52055,"event":"accept_block","hash":"6c88b7bce7...38f7b19206","height":52056,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"64f4a516fc...3b6bd6c1dd","time":"2022-05-16T19:07:05Z","txs_count":0}
{"height":52056,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:05Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52056,"event":"accept_block","hash":"cc2f9d14be...fd59fd2e22","height":52057,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:05Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52056,"event":"accept_block","hash":"cc2f9d14be...fd59fd2e22","height":52057,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"6713b6e0ae...35acfcb168","time":"2022-05-16T19:07:05Z","txs_count":0}
{"height":52057,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:05Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52057,"event":"accept_block","hash":"e550e39341...5f0c1c115c","height":52058,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:05Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52057,"event":"accept_block","hash":"e550e39341...5f0c1c115c","height":52058,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"c5ac62ca4c...d1bd4cd324","time":"2022-05-16T19:07:05Z","txs_count":0}
{"height":52058,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:05Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52058,"event":"accept_block","hash":"a490297a1d...a2be9be7f4","height":52059,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:06Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52058,"event":"accept_block","hash":"a490297a1d...a2be9be7f4","height":52059,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"9659ab990e...30376bdc28","time":"2022-05-16T19:07:06Z","txs_count":0}
{"height":52059,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:06Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52059,"event":"accept_block","hash":"6a0caabf64...830d4e6ba7","height":52060,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:06Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52059,"event":"accept_block","hash":"6a0caabf64...830d4e6ba7","height":52060,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"bc2a208671...2370f73a15","time":"2022-05-16T19:07:06Z","txs_count":0}
{"height":52060,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:06Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52060,"event":"accept_block","hash":"323145a316...da5a804f05","height":52061,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:06Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52060,"event":"accept_block","hash":"323145a316...da5a804f05","height":52061,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"71fa51cca2...9fa729f56f","time":"2022-05-16T19:07:07Z","txs_count":0}
{"height":52061,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:07Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52061,"event":"accept_block","hash":"6cc113f131...a4b3f447e0","height":52062,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:07Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52061,"event":"accept_block","hash":"6cc113f131...a4b3f447e0","height":52062,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"d73fc5b1a7...5851e30817","time":"2022-05-16T19:07:07Z","txs_count":0}
{"height":52062,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:07Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52062,"event":"accept_block","hash":"c9a930f1a8...156ac036fb","height":52063,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:07Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52062,"event":"accept_block","hash":"c9a930f1a8...156ac036fb","height":52063,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"bfdf219dd0...0c09b3bd3d","time":"2022-05-16T19:07:07Z","txs_count":0}
{"height":52063,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:07Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52063,"event":"accept_block","hash":"70f4e9e461...d50372bd8e","height":52064,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:07Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52063,"event":"accept_block","hash":"70f4e9e461...d50372bd8e","height":52064,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"8725c10c1d...07140fc80e","time":"2022-05-16T19:07:07Z","txs_count":0}
{"height":52064,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:07Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52064,"event":"accept_block","hash":"d8b0133a51...2993557754","height":52065,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:08Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52064,"event":"accept_block","hash":"d8b0133a51...2993557754","height":52065,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"06fed25c70...e8f2792e3b","time":"2022-05-16T19:07:08Z","txs_count":0}
{"height":52065,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:08Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52065,"event":"accept_block","hash":"529edf4bf6...7e1be13e73","height":52066,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:08Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52065,"event":"accept_block","hash":"529edf4bf6...7e1be13e73","height":52066,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"5efd82aed2...7c8943ee68","time":"2022-05-16T19:07:08Z","txs_count":0}
{"height":52066,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:08Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52066,"event":"accept_block","hash":"32d927cbe0...90fe238e0b","height":52067,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:08Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52066,"event":"accept_block","hash":"32d927cbe0...90fe238e0b","height":52067,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"5606342877...864c9c6269","time":"2022-05-16T19:07:08Z","txs_count":0}
{"height":52067,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:08Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52067,"event":"accept_block","hash":"886135cf3d...2f4fa17482","height":52068,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:09Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52067,"event":"accept_block","hash":"886135cf3d...2f4fa17482","height":52068,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"af548090b2...83e59aa340","time":"2022-05-16T19:07:09Z","txs_count":0}
{"height":52068,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:09Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52068,"event":"accept_block","hash":"6ca40a8ac6...1c8316bc79","height":52069,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:09Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52068,"event":"accept_block","hash":"6ca40a8ac6...1c8316bc79","height":52069,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"a145ecb039...1ac52ed471","time":"2022-05-16T19:07:09Z","txs_count":0}
{"height":52069,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:09Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52069,"event":"accept_block","hash":"040b6cb795...78269357c7","height":52070,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:09Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52069,"event":"accept_block","hash":"040b6cb795...78269357c7","height":52070,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"3597a0f22e...050389052f","time":"2022-05-16T19:07:09Z","txs_count":0}
{"height":52070,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:09Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52070,"event":"accept_block","hash":"7702d3a6b6...654ecd4fe0","height":52071,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:10Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52070,"event":"accept_block","hash":"7702d3a6b6...654ecd4fe0","height":52071,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"0f62902d71...b5af5a7933","time":"2022-05-16T19:07:10Z","txs_count":0}
{"height":52071,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:10Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52071,"event":"accept_block","hash":"57265e70b2...5a4cfd9977","height":52072,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:10Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52071,"event":"accept_block","hash":"57265e70b2...5a4cfd9977","height":52072,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"60d5685bff...1e0479d97e","time":"2022-05-16T19:07:10Z","txs_count":0}
{"height":52072,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:10Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52072,"event":"accept_block","hash":"3435c22948...4712119d85","height":52073,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:10Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52072,"event":"accept_block","hash":"3435c22948...4712119d85","height":52073,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"1bbc0fdd31...b70b2177d7","time":"2022-05-16T19:07:10Z","txs_count":0}
{"height":52073,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:10Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52073,"event":"accept_block","hash":"74a4f4cd2b...153ae02bdb","height":52074,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:11Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52073,"event":"accept_block","hash":"74a4f4cd2b...153ae02bdb","height":52074,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"c5f4c3cc9b...7b2242130e","time":"2022-05-16T19:07:11Z","txs_count":0}
{"height":52074,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:11Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52074,"event":"accept_block","hash":"6cc1d7b06e...28fc125bba","height":52075,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:11Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52074,"event":"accept_block","hash":"6cc1d7b06e...28fc125bba","height":52075,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"8d1c1dd974...5b1e5c6b48","time":"2022-05-16T19:07:11Z","txs_count":0}
{"height":52075,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:11Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52075,"event":"accept_block","hash":"c6780a7e08...01ef8b2962","height":52076,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:11Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52075,"event":"accept_block","hash":"c6780a7e08...01ef8b2962","height":52076,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"d985e77b5d...2c782996a3","time":"2022-05-16T19:07:11Z","txs_count":0}
{"height":52076,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:11Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52076,"event":"accept_block","hash":"80b03996d8...15da05387a","height":52077,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:11Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52076,"event":"accept_block","hash":"80b03996d8...15da05387a","height":52077,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"b63cd2c4dd...4309ce8c34","time":"2022-05-16T19:07:12Z","txs_count":0}
{"height":52077,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:12Z","txs_count":0}
{"block_time":8,"cert_step":3,"curr_h":52077,"event":"accept_block","hash":"05f60a0a03...4c5d3b2ae1","height":52078,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:12Z","txs_count":0}
{"added":0,"block_time":8,"cert_step":3,"curr_h":52077,"event":"accept_block","hash":"05f60a0a03...4c5d3b2ae1","height":52078,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"f5ef13001f...b1b7a8e48a","time":"2022-05-16T19:07:12Z","txs_count":0}
{"height":52078,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:12Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52078,"event":"accept_block","hash":"dc6060950c...e4848028c2","height":52079,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:12Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52078,"event":"accept_block","hash":"dc6060950c...e4848028c2","height":52079,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"d52723847b...ca00e3a372","time":"2022-05-16T19:07:12Z","txs_count":0}
{"height":52079,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:13Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52079,"event":"accept_block","hash":"3fc9601cd9...dc4bfcde88","height":52080,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:13Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52079,"event":"accept_block","hash":"3fc9601cd9...dc4bfcde88","height":52080,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"8655051f4f...1070d10431","time":"2022-05-16T19:07:13Z","txs_count":0}
{"height":52080,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:13Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52080,"event":"accept_block","hash":"25a355756c...2bb2b9208b","height":52081,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:13Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52080,"event":"accept_block","hash":"25a355756c...2bb2b9208b","height":52081,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"4238a8b670...585118212c","time":"2022-05-16T19:07:13Z","txs_count":0}
{"height":52081,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:13Z","txs_count":0}
{"block_time":2,"cert_step":3,"curr_h":52081,"event":"accept_block","hash":"3fa9d622fc...74bed598d8","height":52082,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:13Z","txs_count":0}
{"added":0,"block_time":2,"cert_step":3,"curr_h":52081,"event":"accept_block","hash":"3fa9d622fc...74bed598d8","height":52082,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"4808317b72...27513ef7d8","time":"2022-05-16T19:07:13Z","txs_count":0}
{"height":52082,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:13Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52082,"event":"accept_block","hash":"d5e8896656...2bbfe3ce8f","height":52083,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:13Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52082,"event":"accept_block","hash":"d5e8896656...2bbfe3ce8f","height":52083,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"326762ebd6...07e7b45345","time":"2022-05-16T19:07:13Z","txs_count":0}
{"height":52083,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:13Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52083,"event":"accept_block","hash":"9dd28cab0b...ad0faa79f1","height":52084,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:14Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52083,"event":"accept_block","hash":"9dd28cab0b...ad0faa79f1","height":52084,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"d443eeb069...3db27391cf","time":"2022-05-16T19:07:14Z","txs_count":0}
{"height":52084,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:14Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52084,"event":"accept_block","hash":"26b368d4be...3919962b44","height":52085,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:14Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52084,"event":"accept_block","hash":"26b368d4be...3919962b44","height":52085,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"51ae06ea86...04e7b3532d","time":"2022-05-16T19:07:14Z","txs_count":0}
{"height":52085,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:14Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52085,"event":"accept_block","hash":"6e9bf7c126...e9853f3e74","height":52086,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:14Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52085,"event":"accept_block","hash":"6e9bf7c126...e9853f3e74","height":52086,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"761e04db9a...4d812e6e2e","time":"2022-05-16T19:07:14Z","txs_count":0}
{"height":52086,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:14Z","txs_count":0}
{"block_time":10,"cert_step":3,"curr_h":52086,"event":"accept_block","hash":"6f603e4ed3...83af1aa5f2","height":52087,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:14Z","txs_count":0}
{"added":0,"block_time":10,"cert_step":3,"curr_h":52086,"event":"accept_block","hash":"6f603e4ed3...83af1aa5f2","height":52087,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"69858ff287...6c95702daf","time":"2022-05-16T19:07:14Z","txs_count":0}
{"height":52087,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:14Z","txs_count":0}
{"block_time":3,"cert_step":3,"curr_h":52087,"event":"accept_block","hash":"ff1cf4ca2b...3e9620fc92","height":52088,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:14Z","txs_count":0}
{"added":0,"block_time":3,"cert_step":3,"curr_h":52087,"event":"accept_block","hash":"ff1cf4ca2b...3e9620fc92","height":52088,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"e2ff68f877...bb7889695f","time":"2022-05-16T19:07:14Z","txs_count":0}
{"height":52088,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:14Z","txs_count":0}
{"block_time":9,"cert_step":3,"curr_h":52088,"event":"accept_block","hash":"c73d67b755...4634ee592e","height":52089,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:14Z","txs_count":0}
{"added":0,"block_time":9,"cert_step":3,"curr_h":52088,"event":"accept_block","hash":"c73d67b755...4634ee592e","height":52089,"level":"info","msg":"state transition completed","process":"chain","prov":30,"state_hash":"e7a2328927...c2e6c8b9d0","time":"2022-05-16T19:07:14Z","txs_count":0}
{"height":52089,"level":"info","mem_alloc_size":0,"mem_txs_len":0,"msg":"processing block completed","process":"mempool","time":"2022-05-16T19:07:14Z","txs_count":0}
{"brokers_num":1,"clients_per_broker":1000,"level":"info","msg":"Start graphql notification service","process":"gql","time":"2022-05-16T19:07:14Z"}
{"grpc_addr":"127.0.0.1:8585","grpc_network":"tcp","level":"info","msg":"launch peer connections","process":"kadcast","time":"2022-05-16T19:07:14Z"}
{"addr":"0.0.0.0:9500","level":"info","msg":"GraphQL HTTP server listening","net":"tcp","process":"gql","time":"2022-05-16T19:07:14Z","tls":false}
{"id":1,"level":"info","msg":"start consensus_loop","process":"chain","time":"2022-05-16T19:07:14Z"}
{"app":"dusk","level":"info","msg":"initialization complete","prefix":"main","time":"2022-05-16T19:07:14Z"}
{"addr":"/opt/dusk/dusk_data/dusk-grpc.sock","app":"dusk","level":"info","msg":"gRPC HTTP server listening","net":"unix","prefix":"main","time":"2022-05-16T19:07:14Z"}
{"curr_h":52090,"level":"info","msg":"discarding too-far message","phase":"agreement","process":"consensus","round":130158,"time":"2022-05-16T19:07:15Z","topic":"Agreement"}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":5,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"curr_h":52090,"level":"info","msg":"discarding too-far message","phase":"agreement","process":"consensus","round":130158,"time":"2022-05-16T19:07:15Z","topic":"AggrAgreement"}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"curr_h":52089,"level":"info","msg":"start syncing","process":"sync","r_addr":"143.110.235.73:9000","target":52589,"time":"2022-05-16T19:07:15Z","tip":130158}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"error":"newblock msg is not signed by a block generator","level":"error","msg":"failed to verify newblock","msg_blockhash":"49ae4b05449c301481bef78673fcd1cff08e36238d08f220e51077209aebccaa","msg_pubkey":"ada282d4c9e0ccf9aff920f50f8a4484f62e23a811fe015c88dac760f891b6bfa601e5d30c167ea2a81384ab41210b8d0f6d9241b434f3b0e2127711b1ea575cc661d14f11413c18799475da98e942793171822fb8df382a6da7866ebe52046c","msg_round":130159,"msg_signature":"b5240ea19b8e2388ef437e7fbef04c327eba01f3274b1eb7b23415cecfc52bdc6b20864069abd4a13de08397defc388c","msg_step":1,"phase":"selector","process":"consensus","seed":"a8499d35aaaec838af7a90003dcc2446ea2dc9f63e611c9965a4107c9b04160c06798c19df2f890ea6583b173346319b","time":"2022-05-16T19:07:15Z"}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":2,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:15Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130159,"step":3,"time":"2022-05-16T19:07:16Z","topic":17}
{"curr_h":52090,"level":"info","msg":"discarding too-far message","phase":"agreement","process":"consensus","round":130159,"time":"2022-05-16T19:07:16Z","topic":"Agreement"}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":6,"time":"2022-05-16T19:07:16Z","topic":17}
{"level":"warning","msg":"message not topics.NewBlock","phase":"selector","process":"consensus","round":130158,"step":5,"time":"2022-05-16T19:07:16Z","topic":17}
{"curr_h":52090,"level":"info","msg":"discarding too-far message","phase":"agreement","process":"consensus","round":130159,"time":"2022-05-16T19:07:16Z","topic":"Agreement"}
{"level":"info","msg":"syncing peer provided the next block","process":"chain","r_addr":"143.110.235.73:9000","time":"2022-05-16T19:07:16Z"}
{"id":1,"level":"info","msg":"consensus_loop terminated","process":"chain","time":"2022-05-16T19:07:16Z"}
{"block_time":9,"cert_step":3,"curr_h":52089,"event":"accept_block","hash":"e00e7f1771...37ba1c2130","height":52090,"level":"info","msg":"run state transition","process":"chain","prov":30,"time":"2022-05-16T19:07:16Z","txs_count":0}
{"added":-6,"block_time":9,"cert_step":3,"curr_h":52089,"event":"accept_block","hash":"e00e7f1771...37ba1c2130","height":52090,"level":"info","msg":"state transition completed","process":"chain","prov":24,"state_hash":"9102c6e0f6...ba694db0e8","time":"2022-05-16T19:07:16Z","txs_count":0}
goshawk-3 commented 2 years ago

As per printed provisioners, this is a result from Rusk service. 

{
  "level": "info",
  "msg": "get provisioners on finalize",
  "pres.Provisioners": 24,
  "prov": [
    "BLS key: a75a89b75e...2a3625f122, Stakes: [Value: 2000000000000000, Reward: 37397936100176, Counter: 0, Eligibility: 0]",
    "BLS key: b466d1f602...184e00b4d5, Stakes: [Value: 2000000000000000, Reward: 38333685518346, Counter: 0, Eligibility: 0]",
    "BLS key: ada282d4c9...6ebe52046c, Stakes: [Value: 2000000000000000, Reward: 36217749880722, Counter: 0, Eligibility: 0]",
    "BLS key: ad0991dc99...c70be38b2d, Stakes: [Value: 2000000000000000, Reward: 38881167323938, Counter: 0, Eligibility: 0]",
    "BLS key: 8b12640134...82f98a2f42, Stakes: [Value: 1000000000000000, Reward: 12657600000000, Counter: 1, Eligibility: 12960]",
    "BLS key: b14c07b725...4d9c4e64e4, Stakes: [Value: 2000000000000000, Reward: 36748800000000, Counter: 0, Eligibility: 0]",
    "BLS key: 912ee72e6f...3f3b7e19b3, Stakes: [Value: 1000000000000000, Reward: 13017600000000, Counter: 1, Eligibility: 15120]",
    "BLS key: 919a4a7a50...fe225175fe, Stakes: [Value: 1000000000000000, Reward: 12916800000000, Counter: 1, Eligibility: 12960]",
    "BLS key: 8a04b7c421...a7ce0a5fac, Stakes: [Value: 1000000000000000, Reward: 13233600000000, Counter: 1, Eligibility: 12960]",
    "BLS key: 92480e3755...53e83884cf, Stakes: [Value: 2000000000000000, Reward: 38033104182213, Counter: 0, Eligibility: 0]",
    "BLS key: 9569b0410b...56a861632b, Stakes: [Value: 1000000000000000, Reward: 12038400000000, Counter: 1, Eligibility: 12960]",
    "BLS key: b586bedea1...ea59a9d9dd, Stakes: [Value: 1000000000000000, Reward: 12686400000000, Counter: 1, Eligibility: 12960]",
    "BLS key: 945f388526...1a46ccade4, Stakes: [Value: 2000000000000000, Reward: 38089045630428, Counter: 0, Eligibility: 0]",
    "BLS key: 924b8dabe2...afc4b1b182, Stakes: [Value: 1000000000000000, Reward: 11376000000000, Counter: 1, Eligibility: 12960]",
    "BLS key: ab61d57036...0213a8294a, Stakes: [Value: 1000000000000000, Reward: 11980800000000, Counter: 1, Eligibility: 15120]",
    "BLS key: 904c065093...5113dd8080, Stakes: [Value: 2000000000000000, Reward: 37428390256804, Counter: 0, Eligibility: 0]",
    "BLS key: 85924f6114...fae1316c90, Stakes: [Value: 1000000000000000, Reward: 11880000000000, Counter: 1, Eligibility: 15120]",
    "BLS key: 84686268b6...a449b7119e, Stakes: [Value: 2000000000000000, Reward: 36764397386580, Counter: 0, Eligibility: 0]",
    "BLS key: 9599c75362...1442ea2e86, Stakes: [Value: 2000000000000000, Reward: 37153904560769, Counter: 0, Eligibility: 0]",
    "BLS key: ac0c2c54e5...223f47c040, Stakes: [Value: 1000000000000000, Reward: 12153600000000, Counter: 1, Eligibility: 12960]",
    "BLS key: b74d6822c0...4c0d7ce13c, Stakes: [Value: 1000000000000000, Reward: 12816000000000, Counter: 1, Eligibility: 12960]",
    "BLS key: b3acd65f5a...95bcc9d693, Stakes: [Value: 1000000000000000, Reward: 11534400000000, Counter: 3, Eligibility: 15120]",
    "BLS key: a05e4343c1...973a503cd7, Stakes: [Value: 1000000000000000, Reward: 12873600000000, Counter: 1, Eligibility: 12960]",
    "BLS key: 85890e3b66...c6017d8c9f, Stakes: [Value: 2000000000000000, Reward: 37483423060007, Counter: 0, Eligibility: 0]"
  ],
  "time": "2022-06-06T14:00:59Z"
}

Missing provisioners:

"BLS key: b39256ec7b...cdcfbe5077, Stakes: [Value: 1000000000000000, Reward: 12542400000000, Counter: 1, Eligibility: 12960]",
"BLS key: 99d7d45a89...bc0a50e19b, Stakes: [Value: 1000000000000000, Reward: 11851200000000, Counter: 1, Eligibility: 12960]",
"BLS key: 8cd3f90e8c...d1607b831f, Stakes: [Value: 2000000000000000, Reward: 38190056212307, Counter: 0, Eligibility: 0]",
"BLS key: a9c24b6f39...4cc188e510, Stakes: [Value: 2000000000000000, Reward: 38451533691674, Counter: 0, Eligibility: 0]",
"BLS key: b5bcd96e25...2bc6b371af, Stakes: [Value: 2000000000000000, Reward: 37485322830793, Counter: 0, Eligibility: 0]",
goshawk-3 commented 2 years ago

Stake Contract method pub fn stakes(&self) returns a vector with len of 24.

2022-06-07T07:32:54.607410Z  INFO rusk::services::state: Received GetEphemeralStateRoot request
2022-06-07T07:32:54.608106Z  INFO rusk::services::state: Received Finalize request
2022-06-07T07:32:54.623288Z  INFO rusk::services::state: Received GetProvisioners request
2022-06-07T07:32:54.702075Z  INFO rusk::state: get stakes 31

2022-06-07T07:32:54.769188Z  INFO rusk::services::state: Received GetEphemeralStateRoot request
2022-06-07T07:32:54.769904Z  INFO rusk::services::state: Received Finalize request
2022-06-07T07:32:54.785533Z  INFO rusk::services::state: Received GetProvisioners request
2022-06-07T07:32:54.843927Z  INFO rusk::state: get stakes 24
goshawk-3 commented 2 years ago

As discussed, with regard to VM2 expected changes this issue can be put on hold for now.

goshawk-3 commented 2 years ago

Another occurrence of the issue on devnet (node-53):

{
  "block_time": 13,
  "cert_step": 3,
  "curr_h": 142140,
  "e_prov": 95,
  "event": "accept_block",
  "hash": "fb448f7cbf...e464064435",
  "height": 142141,
  "level": "info",
  "msg": "run state transition",
  "process": "chain",
  "prov": 95,
  "time": "2022-07-08T09:47:36Z",
  "txs_count": 0
}

{
  "added": -4,
  "block_time": 13,
  "cert_step": 3,
  "curr_h": 142140,
  "e_prov": 91,
  "event": "accept_block",
  "hash": "fb448f7cbf...e464064435",
  "height": 142141,
  "level": "info",
  "msg": "state transition completed",
  "process": "chain",
  "prov": 91,
  "state_hash": "920d5534f9...b1e85a09be",
  "time": "2022-07-07T04:50:10Z",
  "txs_count": 0
}