search

helium / blockchain-etl

Blockchain follower that follows and stores the Helium blockchain
Apache License 2.0
64 stars 37 forks source link

ETL running but not syncing #326

Closed disk91 closed 2 years ago

disk91 commented 2 years ago

Yesterday at 22:46 CEST, my ETL stopped synching but the process was still running. I stopped it and restart it and it immediately back on work.

The log file is a suite of (not sure relevant, but no significative error found):

2022-05-05 02:22:11.679 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:22:21.680 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:22:31.681 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:22:41.682 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:22:51.766 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:23:01.767 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:23:11.768 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:23:21.784 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:23:31.785 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:23:34.758 [error] <0.30643.50>@libp2p_stream_relay:handle_server_data:{193,13} fail to pass request {libp2p_relay_bridge_cr_pb,"/p2p/11L79DZjRsNBDaJipPiK3HYVrX3yeSd6K7Q7fDshCrUQPKWCAnB","/ip4/209.146.101.151/tcp/44158"} Server not found
2022-05-05 02:23:41.786 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:23:47.546 [error] <0.53.51>@libp2p_stream_relay:handle_server_data:{193,13} fail to pass request {libp2p_relay_bridge_cr_pb,"/p2p/11bU9qKGWV927tJsPjDqZJ7o9icqqb6FQzpzEMo83tp6vkj8yhp","/ip4/24.11.25.56/tcp/44158"} Server not found
2022-05-05 02:23:51.908 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:24:01.909 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:24:11.910 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:24:21.916 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:24:22.452 [info] <0.1394.0>@libp2p_peerbook:notify_peers:{749,5} gossiping out 11 notify peers
2022-05-05 02:24:31.917 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:24:41.918 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:24:51.919 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:25:01.920 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:25:11.921 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:25:21.922 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:25:31.923 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:25:41.924 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:25:51.925 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:01.926 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:11.927 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:17.337 [info] <0.12327.51>@libp2p_stream_proxy:init:{59,5} init proxy server with {{connection,libp2p_yamux_stream,<0.10625.51>},[[],<0.1389.0>,blockchain_swarm]}
2022-05-05 02:26:17.398 [info] <0.12327.51>@libp2p_stream_proxy:handle_server_data:{118,5} server got proxy request {libp2p_proxy_req_pb,"/p2p/11yLLJ4uRJz7BbAxu3ZXTBaJ3AC5pfuXbgR4UaRhDNKKf8DJmwt"}
2022-05-05 02:26:17.398 [info] <0.12327.51>@libp2p_proxy_server:proxy:{69,13} handling proxy req <<19,70,49,137,224,237,237,210,48,65,44,46,142,180,194,83>> from <0.12327.51> to "/p2p/11yLLJ4uRJz7BbAxu3ZXTBaJ3AC5pfuXbgR4UaRhDNKKf8DJmwt"
2022-05-05 02:26:21.928 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:22.458 [info] <0.1417.0>@libp2p_transport_relay:connect_to:{71,5} init relay transport with ["/p2p/114NxrPhE1T95qN9nXDPR35vZLFbi9XDjdWJK1cexgvWejjJusF/p2p-circuit/p2p/11yLLJ4uRJz7BbAxu3ZXTBaJ3AC5pfuXbgR4UaRhDNKKf8DJmwt","/p2p/114NxrPhE1T95qN9nXDPR35vZLFbi9XDjdWJK1cexgvWejjJusF","/p2p/11yLLJ4uRJz7BbAxu3ZXTBaJ3AC5pfuXbgR4UaRhDNKKf8DJmwt"]
2022-05-05 02:26:31.929 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:41.930 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:51.931 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:26:54.558 [info] <0.1393.0>@libp2p_group_gossip_server:drop_target:{616,5} dropping target for peerbook <0.1397.0>
2022-05-05 02:27:01.933 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:27:11.934 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:27:21.935 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:27:22.832 [info] <0.5059.49>@blockchain_worker:start_block_sync:{1017,33} block sync timed out
2022-05-05 02:27:22.833 [info] <0.1421.0>@blockchain_worker:handle_info:{673,53} block sync down: timeout
2022-05-05 02:27:22.835 [info] <0.1421.0>@blockchain_worker:start_sync:{888,13} new block sync starting with Pid: <0.16909.51>, Ref: #Ref<0.1510673116.2780037128.72811>, Peer: "/p2p/11tKD8aQyTvoZckXRekJSSg7puG3KnZX81zkrMHrN6x9Sok9zd7"
2022-05-05 02:27:23.097 [warning] <0.1417.0>@libp2p_proxy_server:handle_info:{229,5} rcvd unknown info msg: {'DOWN',#Ref<0.1510673116.2780037127.211664>,process,<0.13717.51>,normal}
2022-05-05 02:27:27.054 [info] <0.19188.51>@blockchain_sync_handler:handle_data:{132,5} adding sync blocks [1340584,1340585,1340586,1340587,1340588]
2022-05-05 02:27:27.696 [info] <0.19188.51>@blockchain_sync_handler:handle_data:{142,13} Eagerly re-gossiping 1340588
2022-05-05 02:27:31.936 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
2022-05-05 02:27:41.937 [info] <0.1585.0>@be_db_pending_txn:handle_info:{136,5} Submitting 0 pending transactions
madninja commented 2 years ago

Very odd.. there's no data in the logs you posted that seems to indicate that the chain had stopped. I'm going to assume for now that this would have resolved if you would have let it run, but please post again if this happens again