Closed Unded closed 4 months ago
cryi
commented
4 months ago Hi, can you please confirm you run latest image?
docker images --digests
You should have
sha256:7dd758aacc973eafbd70bdd534496fed933b151936742273af605ffb423f010a
If not, use docker pull ghcr.io/tez-capital/tezbox:tezos-v20.0 to get the latest.
There were fixes in past two days which should address this.
cryi
commented
4 months ago We noticed another issue with baker getting stuck and pushed workaround now. Please pull again.
Unded
commented
4 months ago Thank you, for the updates.
I have tried new docker image:
ghcr.io/tez-capital/tezbox:tezos-v20.0 sha256:bfe832c06a21107abb7e7e5179bef24052da0a04e520ad083ddb9ae959864dd8 Unfortunately, the error is still there.
Error logs:
May 30 19:23:25.273: block at level 12 successfully pre-applied in 16.824ms
2024-05-30T19:23:25.371618899Z May 30 19:23:25.371: potential double baking detected at level 12, round 0
2024-05-30T19:23:25.371706339Z May 30 19:23:25.372: failed to forge block for baker2 (tz1gjaF81ZRRvdzjobyfVNsAeSC6PScjfQwN) --
2024-05-30T19:23:25.371727850Z May 30 19:23:25.372: Error:
2024-05-30T19:23:25.371733018Z May 30 19:23:25.372: A block with a higher watermark than the current one (level: 12, round: 0) was previously baked.
2024-05-30T19:23:25.371737278Z May 30 19:23:25.372:
2024-05-30T19:23:29.588072130Z /usr/sbin/eli: [string "preload-libs"]:3025: [string "preload-libs"]:2728: 2 (HTTPNetworkError)
2024-05-30T19:23:29.588100276Z stack traceback:
2024-05-30T19:23:29.588105583Z [C]: in function 'error'
2024-05-30T19:23:29.588110822Z [string "preload-libs"]:3025: in function 'eli.net.download_string'
2024-05-30T19:23:29.588114593Z /ascend/healthchecks/baker:5: in main chunk
2024-05-30T19:23:29.588118853Z [C]: in ?
2024-05-30T19:23:29.990017629Z 19:23:29 [INFO] (ascend) healthcheck for baker:default failed with exit code 1
2024-05-30T19:23:30.191313005Z (/usr/local/bin/octez-baker-PtParisB) TERM: triggering shutdown.
2024-05-30T19:23:30.191350090Z Shutting down the baker...
2024-05-30T19:23:30.191362592Z May 30 19:23:30.191: shutting down operation worker
2024-05-30T19:23:30.191530069Z Error:
2024-05-30T19:23:30.191542360Z Lwt.Resolution_loop.Canceled
2024-05-30T19:23:30.793343899Z 19:23:30 [INFO] (ascend) baker:default stopped
...
May 30 19:23:51.450: block at level 11 successfully pre-applied in 18.920ms
2024-05-30T19:23:51.491881313Z May 30 19:23:51.492: potential double baking detected at level 11, round 8
2024-05-30T19:23:51.492073094Z May 30 19:23:51.492: failed to forge block for baker2 (tz1gjaF81ZRRvdzjobyfVNsAeSC6PScjfQwN) --
2024-05-30T19:23:51.492086853Z May 30 19:23:51.492: Error:
2024-05-30T19:23:51.492093069Z May 30 19:23:51.492: A block with a higher watermark than the current one (level: 11, round: 8) was previously baked.
2024-05-30T19:23:51.492097399Z May 30 19:23:51.492:
2024-05-30T19:23:55.676735382Z May 30 19:23:55.677: (64) received request /chains/main/blocks/head
2024-05-30T19:23:56.848680946Z May 30 19:23:56.848: (64) received request /chains/main/blocks/head
2024-05-30T19:23:58.606499526Z May 30 19:23:58.606: (64) received request /chains/main/blocks/head
2024-05-30T19:24:06.001227622Z May 30 19:24:06.001: end of round 8; proposal slot at level 11, round 9 for
...
May 30 19:24:06.071: waiting 22.179s until it's time to forge block at 2024-05-30T19:24:28-00:00
2024-05-30T19:24:07.531430912Z /usr/sbin/eli: [string "preload-libs"]:3025: [string "preload-libs"]:2728: 2 (HTTPNetworkError)
2024-05-30T19:24:07.531466671Z stack traceback:
2024-05-30T19:24:07.531474423Z [C]: in function 'error'
2024-05-30T19:24:07.531478683Z [string "preload-libs"]:3025: in function 'eli.net.http.download_string'
2024-05-30T19:24:07.531482454Z /ascend/healthchecks/baker:5: in main chunk
2024-05-30T19:24:07.531487204Z [C]: in ?
2024-05-30T19:24:07.933273054Z 19:24:07 [INFO] (ascend) healthcheck for baker:default failed with exit code 1
2024-05-30T19:24:08.134684299Z (/usr/local/bin/octez-baker-PtParisB) TERM: triggering shutdown.
2024-05-30T19:24:08.134736888Z Shutting down the baker...
2024-05-30T19:24:08.134745828Z May 30 19:24:08.135: shutting down operation worker
2024-05-30T19:24:08.134967710Z Error:
2024-05-30T19:24:08.134980561Z Lwt.Resolution_loop.Canceled
2024-05-30T19:24:08.735021995Z 19:24:08 [INFO] (ascend) baker:default stoppedDo you use any custom configuration @Unded ?
cryi
commented
4 months ago Can you please reach out in tezos slack? Just ping in general that you need help with tezbox and I will assist you there 🙂
cryi
commented
4 months ago Anyway from your log ... healtcheck is failing because it is not able to access the node. So it may be good start to exec -it sh into the container and check whether node is accessible on http://127.0.0.1:8732
Unded
commented
4 months ago Do you use any custom configuration @Unded ?
No, I run the docker container using the command from the README:
docker run -d -p 0.0.0.0:8732:8732 ghcr.io/tez-capital/tezbox:tezos-v20.0 parisboxCan you please reach out in tezos slack? Just ping in general that you need help with tezbox and I will assist you there 🙂
No, I have no access to the tezos channels, it would be great if you could invite me
Anyway from your log ... healtcheck is failing because it is not able to access the node. So it may be good start to exec -it sh into the container and check whether node is accessible on http://127.0.0.1:8732
The node works inside the docker container. This time the block generation stopped on block #33.
Command:
wget -O - http://127.0.0.1:8732/chains/main/blocks/headResponse:
{"protocol":"PtParisBxoLz5gzMmn3d9WBQNoPSZakgnkMC2VNuQ3KXfUtUQeZ","chain_id":"NetXtJqPyJGB6Pc","hash":"BKjgyVuhtwL471JY8tR2q2oeDuQKJWemCwbxQqWE3QA9AVWGKTS","header":{"level":33,"proto":1,"predecessor":"BLUU9EQVvmadrpLuD6PhzbhokJN3BCRrtF57z9hmNdkTN8As4Uj","timestamp":"2024-05-31T20:51:44Z","validation_pass":4,"operations_hash":"LLoaehLbNeJVrGQJKpN3jsBySmQ2Xhgutwsxntw57oYLGkWukxs2y","fitness":["02","00000021","","ffffffff","00000015"],"context":"CoUouXUW1H7cW7sb12Dn4waezAXLzVG3PNHmsSvUnvPwsxm1cT1Y","payload_hash":"vh1m2atrXz9D4AnUnpMJR8SgZEZqgtaYGGQRw8GMn89jmP8wRMBV","payload_round":21,"proof_of_work_nonce":"0dcf3209cd7f0000","liquidity_baking_toggle_vote":"pass","adaptive_issuance_vote":"pass","signature":"sigtUgw6k7ghzUEV6MKjHpj66YoSFrf9By6mANnbSWsD9sBd52c4LoWv7EiJSX9YbAHmG1pZuJjYYJwcTet32P5aecGZLemW"},"metadata":{"protocol":"PtParisBxoLz5gzMmn3d9WBQNoPSZakgnkMC2VNuQ3KXfUtUQeZ","next_protocol":"PtParisBxoLz5gzMmn3d9WBQNoPSZakgnkMC2VNuQ3KXfUtUQeZ","test_chain_status":{"status":"not_running"},"max_operations_ttl":33,"max_operation_data_length":32768,"max_block_header_length":289,"max_operation_list_length":[{"max_size":4194304,"max_op":2048},{"max_size":32768},{"max_size":135168,"max_op":132},{"max_size":524288}],"proposer":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","baker":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","level_info":{"level":33,"level_position":32,"cycle":0,"cycle_position":32,"expected_commitment":false},"voting_period_info":{"voting_period":{"index":0,"kind":"proposal","start_position":0},"position":32,"remaining":12255},"nonce_hash":null,"deactivated":[],"balance_updates":[{"kind":"minted","category":"baking rewards","change":"-166667","origin":"block"},{"kind":"freezer","category":"deposits","staker":{"baker_own_stake":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv"},"change":"166667","origin":"block"},{"kind":"minted","category":"baking rewards","change":"-1499999","origin":"block"},{"kind":"contract","contract":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","change":"1499999","origin":"block"},{"kind":"minted","category":"baking bonuses","change":"-166577","origin":"block"},{"kind":"freezer","category":"deposits","staker":{"baker_own_stake":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv"},"change":"166577","origin":"block"},{"kind":"minted","category":"baking bonuses","change":"-1499185","origin":"block"},{"kind":"contract","contract":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","change":"1499185","origin":"block"}],"liquidity_baking_toggle_ema":0,"adaptive_issuance_vote_ema":0,"adaptive_issuance_activation_cycle":6,"implicit_operations_results":[{"kind":"transaction","storage":[{"int":"1"},{"int":"13333412"},{"int":"100"},{"bytes":"01e927f00ef734dfc85919635e9afc9166c83ef9fc00"},{"bytes":"0115eb0104481a6d7921160bc982c5e0a561cd8a3a00"}],"balance_updates":[{"kind":"minted","category":"subsidy","change":"-416666","origin":"subsidy"},{"kind":"contract","contract":"KT1TxqZ8QtKvLu3V3JH7Gx58n7Co8pgtpQU5","change":"416666","origin":"subsidy"}],"consumed_milligas":"206424","storage_size":"4630"}],"proposer_consensus_key":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","baker_consensus_key":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","consumed_milligas":"0","dal_attestation":"0"},"operations":[[{"protocol":"PtParisBxoLz5gzMmn3d9WBQNoPSZakgnkMC2VNuQ3KXfUtUQeZ","chain_id":"NetXtJqPyJGB6Pc","hash":"oojEFrKZZmRc1aK6MYXjDa3An5b5xqrZrajrgFtyi4wNow7QDoe","branch":"BKwSESLtv6FWpkZyztQhvzM4H7BFGLMmdrNYc3XJqEf5SAok4Bb","contents":[{"kind":"attestation","slot":0,"level":32,"round":0,"block_payload_hash":"vh1r7sGV2voPr1Y1D4Rt78QnGfZrHZASNefHmTavBf8Hz2byXU4H","metadata":{"delegate":"tz1gjaF81ZRRvdzjobyfVNsAeSC6PScjfQwN","consensus_power":2290,"consensus_key":"tz1gjaF81ZRRvdzjobyfVNsAeSC6PScjfQwN"}}],"signature":"sigbTUo84XxW1435jW2NWdkbrnELtmhiE1n9nhHKFT5WEuGueBusEXKzQ2uAxyebRVYthqaXHLj7MQ9w6yRKK2oWNJGHv22W"},{"protocol":"PtParisBxoLz5gzMmn3d9WBQNoPSZakgnkMC2VNuQ3KXfUtUQeZ","chain_id":"NetXtJqPyJGB6Pc","hash":"op4TkTMiZRbrSFyT977PdJ4jjTB8scKUpfvn6dkD1doZfpLXL4s","branch":"BKwSESLtv6FWpkZyztQhvzM4H7BFGLMmdrNYc3XJqEf5SAok4Bb","contents":[{"kind":"attestation","slot":1,"level":32,"round":0,"block_payload_hash":"vh1r7sGV2voPr1Y1D4Rt78QnGfZrHZASNefHmTavBf8Hz2byXU4H","metadata":{"delegate":"tz1faswCTDciRzE4oJ9jn2Vm2dvjeyA9fUzU","consensus_power":2331,"consensus_key":"tz1faswCTDciRzE4oJ9jn2Vm2dvjeyA9fUzU"}}],"signature":"sigR5FnpVY2W4kP2wneSdEpnDuPB9PL8zZDnAoqBYorw3BmYgVpEyxoh1zi47ur5v6FgzNqsMyfqzKRtf2jmVKizSoiKt3av"},{"protocol":"PtParisBxoLz5gzMmn3d9WBQNoPSZakgnkMC2VNuQ3KXfUtUQeZ","chain_id":"NetXtJqPyJGB6Pc","hash":"opEXUUh5xsLkXWRSicePfwhQ49AqYKv5CWxrTPAsPZ9vFQPLVir","branch":"BKwSESLtv6FWpkZyztQhvzM4H7BFGLMmdrNYc3XJqEf5SAok4Bb","contents":[{"kind":"attestation","slot":2,"level":32,"round":0,"block_payload_hash":"vh1r7sGV2voPr1Y1D4Rt78QnGfZrHZASNefHmTavBf8Hz2byXU4H","metadata":{"delegate":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv","consensus_power":2379,"consensus_key":"tz1b7tUupMgCNw2cCLpKTkSD1NZzB5TkP2sv"}}],"signature":"sigRqc5J9x2dvwfz5DxohqLETmmSG48kCsvcUR3J6FfDCQFsSpmdAr9CDBggzvsTwXN2AFgYTrJUbPxGE2sXdnn1HoSTs3Nw"}],[],[],[]]}Hi @Unded ,
I would need your email to invite you. Eventually you can reach out in TzC discord or tezos discord.
Anyway I think I found the issue. We had similar issue a day or two back in different project. DNS resolves localhost to ipv6 but the node listens only on ipv4 so it is not able to healthcheck it. I pushed the fix and new images are available. Please docker pull and try again 🤞🏻
Unded
commented
4 months ago Thank you, everything works now!
Hi, I am trying to use the Tezbox for local testing instead of the Flextesa.
I ran the docker container with the following command:
Then, after a few minutes, the private-net stopped generating new blocks on block #36.
The error log: