Alzymologist / Kalatori-backend

Kalatori daemon to handle chain-to-webstore interaction
GNU General Public License v3.0
0 stars 6 forks source link

Demon crashed in production #9

Open lleokaganov opened 2 months ago

lleokaganov commented 2 months ago

Extract from syslog:

Feb 27 17:19:56 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:19:56Z INFO  kalatori::rpc] Processing the block: 19669856.
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z WARN  kalatori::rpc] Lost the connection while processing finalized heads. Retrying...
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z WARN  kalatori::rpc] Lost the connection while listening the endpoint for API client runtime updates. Retrying...
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z ERROR kalatori] Received a fatal error!
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:     failed to update the subscription while processing finalized heads
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:     
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:     Caused by:
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:         0: failed to subscribe to finalized heads
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:         1: Rpc error: RPC error: The background task been terminated because: Networking or low-level protocol error: WebSocket connection error: connection closed; restart required
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:         2: RPC error: The background task been terminated because: Networking or low-level protocol error: WebSocket connection error: connection closed; restart required
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z INFO  kalatori] Initialising the shutdown...
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z ERROR kalatori] Received a fatal error!
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:     failed to get the runtime updates stream
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:     
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:     Caused by:
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:         0: Rpc error: RPC error: The background task been terminated because: Networking or low-level protocol error: WebSocket connection error: connection closed; restart required
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]:         1: RPC error: The background task been terminated because: Networking or low-level protocol error: WebSocket connection error: connection closed; restart required
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z INFO  kalatori] The shutdown signal listener is shut down.
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z INFO  kalatori] The server module is shut down.
Feb 27 17:20:00 ubuntu-8gb-hel1-3 kalatori_1.0.1_start[52682]: [2024-02-27T17:20:00Z INFO  kalatori] Goodbye!
Feb 27 17:20:00 ubuntu-8gb-hel1-3 systemd[1]: kalatori_1.0.1_start.service: Deactivated successfully.