Node stucked at 119397740

DDeAlmeida commented 5 months ago

Traces:

2024-06-17T12:09:01.383707Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN Validator | 61 validators 22 peers ⬇ 422 kB/s ⬆ 345 kB/s 0.00 bps 0 gas/s CPU: 10%, Mem: 24.1 GB
2024-06-17T12:09:01.383717Z  INFO stats: Catchups
Sync block 8BzRJR5ebVp3WRbd9Dy4SACsqmysUKXAAAPXLcGVJRHN@119372741
Shard sync status: Shard 0 done
Next blocks to catch up:
Sync block EvEtXf5cTuPvypa3ApNdJgTcDZonjYs7yAVYHu3FtB3V@119342736
Shard sync status: Shard 5 done
Next blocks to catch up:
Sync block 8DEPnFctafqwnkHxirsaok3xpK7PQNN8HzpUd3F9a32M@119252736
Shard sync status: Shard 2 done
Next blocks to catch up:
2024-06-17T12:09:01.567779Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:01.595549Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:01.742211Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:02.705286Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:03.156177Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:05.799330Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:05.876094Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:05.901688Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:06.003282Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:06.024378Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:06.950999Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:06.975069Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:07.104272Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:07.191147Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:11.384918Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN Validator | 61 validators 21 peers ⬇ 410 kB/s ⬆ 399 kB/s 0.00 bps 0 gas/s CPU: 12%, Mem: 24.1 GB
2024-06-17T12:09:11.384930Z  INFO stats: Catchups
Sync block 8BzRJR5ebVp3WRbd9Dy4SACsqmysUKXAAAPXLcGVJRHN@119372741
Shard sync status: Shard 0 done
Next blocks to catch up:
Sync block EvEtXf5cTuPvypa3ApNdJgTcDZonjYs7yAVYHu3FtB3V@119342736
Shard sync status: Shard 5 done
Next blocks to catch up:
Sync block 8DEPnFctafqwnkHxirsaok3xpK7PQNN8HzpUd3F9a32M@119252736
Shard sync status: Shard 2 done
Next blocks to catch up:
2024-06-17T12:09:12.361298Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:12.426315Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:12.427452Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:12.441108Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:12.450665Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
2024-06-17T12:09:13.531484Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)

MaximAntsiferov commented 5 months ago

The same problem. Stuck at 119397740, but logs are not the same.

2024-06-17T12:16:47.956299Z ERROR client: Error processing sync blocks err=InvalidNextBPHash
2024-06-17T12:16:47.956329Z  WARN client: Banning node for sending invalid block headers
2024-06-17T12:16:48.830504Z  WARN network: Banning peer ed25519:3mcMBWE83z9KXvnPvfhcnRYfnSvc48wMKcH5YKAQeUx2 for BadBlockHeader
2024-06-17T12:16:57.807109Z  INFO stats: #119397740 Downloading headers 0.00% (3978 left; at 119397740) 21 peers ⬇ 411 kB/s ⬆ 389 kB/s 0.00 bps 0 gas/s CPU: 5%, Mem: 290 MB
2024-06-17T12:16:58.079527Z ERROR client: Error processing sync blocks err=InvalidNextBPHash
2024-06-17T12:16:58.079556Z  WARN client: Banning node for sending invalid block headers
2024-06-17T12:16:58.876511Z  WARN network: Banning peer ed25519:Fwq4mkdjuaA7sqSD7f5wmG3nqpzQecWqmGhaDQZKCFHi for BadBlockHeader
2024-06-17T12:17:07.808539Z  INFO stats: #119397740 Downloading headers 0.00% (3985 left; at 119397740) 20 peers ⬇ 376 kB/s ⬆ 317 kB/s 0.00 bps 0 gas/s CPU: 5%, Mem: 291 MB
2024-06-17T12:17:07.868805Z  WARN sync: Sync: ban a peer: ed25519:Fwq4mkdjuaA7sqSD7f5wmG3nqpzQecWqmGhaDQZKCFHi@178.18.252.175:24567, for not providing enough headers. Peer's height:  119401725
2024-06-17T12:17:07.868879Z  WARN network: Banning peer ed25519:Fwq4mkdjuaA7sqSD7f5wmG3nqpzQecWqmGhaDQZKCFHi for ProvidedNotEnoughHeaders
2024-06-17T12:17:17.809631Z  INFO stats: #119397740 Downloading headers 0.00% (3985 left; at 119397740) 20 peers ⬇ 367 kB/s ⬆ 240 kB/s 0.00 bps 0 gas/s CPU: 5%, Mem: 291 MB
2024-06-17T12:17:18.094656Z ERROR client: Error processing sync blocks err=InvalidNextBPHash
2024-06-17T12:17:18.094732Z  WARN client: Banning node for sending invalid block headers
2024-06-17T12:17:18.964613Z  WARN network: Banning peer ed25519:9t4o7Gcu95dqCtJeYB8ftinhySQWNXibmkY7DGo3uRMs for BadBlockHeader
2024-06-17T12:17:27.810202Z  INFO stats: #119397740 Downloading headers 0.00% (3993 left; at 119397740) 19 peers ⬇ 318 kB/s ⬆ 161 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 294 MB
2024-06-17T12:17:27.879752Z  WARN sync: Sync: ban a peer: ed25519:9t4o7Gcu95dqCtJeYB8ftinhySQWNXibmkY7DGo3uRMs@37.27.130.73:24567, for not providing enough headers. Peer's height:  119401733
2024-06-17T12:17:27.880339Z  WARN network: Banning peer ed25519:9t4o7Gcu95dqCtJeYB8ftinhySQWNXibmkY7DGo3uRMs for ProvidedNotEnoughHeaders
2024-06-17T12:17:37.811537Z  INFO stats: #119397740 Downloading headers 0.00% (3993 left; at 119397740) 19 peers ⬇ 291 kB/s ⬆ 77.6 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 294 MB
2024-06-17T12:17:38.280305Z ERROR client: Error processing sync blocks err=InvalidNextBPHash
2024-06-17T12:17:38.280331Z  WARN client: Banning node for sending invalid block headers
2024-06-17T12:17:40.053630Z  WARN network: Banning peer ed25519:9qXiUC2rYCB8x4BfhRVWHmKFWWPBuafBojpsMcUSLbuJ for BadBlockHeader
2024-06-17T12:17:47.842632Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 245 kB/s ⬆ 38.0 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 298 MB
2024-06-17T12:17:56.135276Z  WARN network: Message dropped because TTL reached 0. msg=RoutedMessageV2 { msg: RoutedMessage { target: PeerId(ed25519:5FyQnDv1ZXbcSPrUbSALDcjYMyLJiNUSze6Lhag4ZqeZ), author: ed25519:Cj1Z4wdwiLr84UDgd2jafQmisNDpXKzBUvxcoi6zkyLH, signature: ed25519:2ScfkCXH4HtBKHxAKFX3LdmG3kajyRvfdzcKHKzxgYYHWHTK2ErcspFMsXc8Fen38F1d9JqH2jUB71wJ4YraUVz6, ttl: 0, body: PartialEncodedStateWitnessForward }, created_at: Some(2024-06-17 12:17:50.785188615 +00:00:00), num_hops: Some(0) } from=ed25519:6iL7DkACo2X75f53fPx7tr7GRwJB91rZQTkNX8bBoHov
2024-06-17T12:17:57.849663Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 19 peers ⬇ 239 kB/s ⬆ 50.5 kB/s 0.00 bps 0 gas/s CPU: 8%, Mem: 300 MB
2024-06-17T12:17:58.400733Z ERROR client: Error processing sync blocks err=InvalidNextBPHash
2024-06-17T12:17:58.400768Z  WARN client: Banning node for sending invalid block headers
2024-06-17T12:18:00.124432Z  WARN network: Banning peer ed25519:6iL7DkACo2X75f53fPx7tr7GRwJB91rZQTkNX8bBoHov for BadBlockHeader
2024-06-17T12:18:07.844767Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 227 kB/s ⬆ 75.0 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 302 MB
2024-06-17T12:18:17.846285Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 225 kB/s ⬆ 76.2 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 298 MB
2024-06-17T12:18:27.846483Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 240 kB/s ⬆ 78.0 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 297 MB
2024-06-17T12:18:37.849877Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 256 kB/s ⬆ 81.9 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 298 MB
2024-06-17T12:18:47.848862Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 277 kB/s ⬆ 82.2 kB/s 0.00 bps 0 gas/s CPU: 4%, Mem: 298 MB
2024-06-17T12:18:57.864095Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 18 peers ⬇ 253 kB/s ⬆ 78.7 kB/s 0.00 bps 0 gas/s CPU: 2%, Mem: 301 MB
2024-06-17T12:19:07.852562Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN 61 validators 19 peers ⬇ 268 kB/s ⬆ 59.2 kB/s 0.00 bps 0 gas/s CPU: 5%, Mem: 303 MB

ivangrapher commented 5 months ago

Node stuck on block 119397740

ainError(InvalidChunkHeight)
Jun 17 14:44:00 Tarab239 neard[3944297]: 2024-06-17T12:44:00.553416Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:00 Tarab239 neard[3944297]: 2024-06-17T12:44:00.584492Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:00 Tarab239 neard[3944297]: 2024-06-17T12:44:00.907721Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.305922Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.463862Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.566567Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.721739Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.839642Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.901098Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.020690Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.163274Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.386279Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.390982Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.392437Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.631698Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.676715Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.798269Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:03 Tarab239 neard[3944297]: 2024-06-17T12:44:03.992758Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.002703Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.012935Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.016324Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)
Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.346211Z  INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN Validator | 61 validators 18 peers ⬇ 316 kB/s ⬆ 338 kB/s 0.00 bps 0 gas/s CPU: 14%, Mem: 4.24 GB
Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.379637Z  WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)

tarabukinivan commented 5 months ago

ainError(InvalidChunkHeight) Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.305922Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.463862Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.566567Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.721739Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.839642Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:01 Tarab239 neard[3944297]: 2024-06-17T12:44:01.901098Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.020690Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.163274Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.386279Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.390982Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.392437Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.631698Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.676715Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:02 Tarab239 neard[3944297]: 2024-06-17T12:44:02.798269Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:03 Tarab239 neard[3944297]: 2024-06-17T12:44:03.992758Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.002703Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.012935Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.016324Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight) Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.346211Z INFO stats: #119397740 CEg6gm8Qhh4uLMJ1eNy8rjCDpN63z92nyWGgEKPfHbqN Validator | 61 validators 18 peers ⬇ 316 kB/s ⬆ 338 kB/s 0.00 bps 0 gas/s CPU: 14%, Mem: 4.24 GB Jun 17 14:44:04 Tarab239 neard[3944297]: 2024-06-17T12:44:04.379637Z WARN chunks: Error processing partial encoded chunk: ChainError(InvalidChunkHeight)

GO2Pro commented 5 months ago

Stuck on the block 119407740 not 119397740

Jun 17 17:32:02 stakewars-iv-h15a neard[181305]: 2024-06-17T15:32:02.186612Z  INFO stats: #119407740 Downloading blocks 0.00% (2123 left; at 119407740) 30 peers ⬇ 559 kB/s ⬆ 235 kB/s 0.00 bps 0 gas/s CPU: 229%, Mem: 1.88 GB
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]: 2024-06-17T15:32:02.186650Z  INFO stats: Catchups
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]: Sync block 2AaNKtDVHbw6w1VVBNrfz43aeGA1w7TUAZFP5997as2Z@119402741
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]: Shard sync status: Shard 4 apply complete
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]: Next blocks to catch up: done
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]: 2024-06-17T15:32:02.569526Z  WARN near_store::db::rocksdb: target="store::db::rocksdb" making a write batch took a very long time, make smaller transactions! elapsed=171.864757ms backtrace=   0: <near_store::db::rocksdb::RocksDB as near_store::db::Database>::write
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    1: near_store::StoreUpdate::commit
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    2: <near_chain::runtime::NightshadeRuntime as near_chain::types::RuntimeAdapter>::apply_state_part
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    3: <actix::address::envelope::SyncEnvelopeProxy<M> as actix::address::envelope::EnvelopeProxy<A>>::handle
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    4: <actix::contextimpl::ContextFut<A,C> as core::future::future::Future>::poll
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    5: tokio::runtime::task::raw::poll
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    6: tokio::task::local::LocalSet::tick
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    7: tokio::task::local::LocalSet::run_until::{{closure}}
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    8: std::sys_common::backtrace::__rust_begin_short_backtrace
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:    9: core::ops::function::FnOnce::call_once{{vtable.shim}}
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:   10: std::sys::pal::unix::thread::Thread::new::thread_start
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:   11: start_thread
Jun 17 17:32:02 stakewars-iv-h15a neard[181305]:   12: clone

telezhnaya commented 5 months ago

The network was reset, this problem should not appear anymore

near / stakewars-iv

Node stucked at 119397740 #140