EvernodeXRPL / evernode-host

Evernode host installer
Other
53 stars 8 forks source link

Hosts show active for one heartbeat only #389

Open ObiTwo2 opened 3 weeks ago

ObiTwo2 commented 3 weeks ago

My hosts are all experiencing the same issue, after a reboot they are active for only one heartbeat then they go inactive.

Upgraded them to 0.9.0 with same results.

I've also tried a transfer and reinstall without any change.

They all share a common Xahau node, so a likely candidate. I upgraded the specs on the node when this began in case that was the issue, no change:

Here's the server_info from the node: { "result" : { "info" : { "build_version" : "2024.4.21-release+858", "complete_ledgers" : "empty", "hostid" : "vmi1726973.contaboserver.net", "initial_sync_duration_us" : "35141304", "io_latency_ms" : 1, "jq_trans_overflow" : "320", "last_close" : { "converge_time_s" : 3.001, "proposers" : 19 }, "load" : { "job_types" : [ { "job_type" : "clientFeeChange", "per_second" : 18 }, { "in_progress" : 1, "job_type" : "clientRPC" }, { "job_type" : "untrustedValidation", "per_second" : 1 }, { "job_type" : "ledgerRequest", "peak_time" : 5, "per_second" : 9 }, { "job_type" : "transaction", "peak_time" : 3, "per_second" : 56 }, { "avg_time" : 1, "job_type" : "batch", "peak_time" : 18, "per_second" : 16 }, { "avg_time" : 1, "job_type" : "ledgerData", "peak_time" : 25, "per_second" : 1 }, { "avg_time" : 1, "in_progress" : 1, "job_type" : "advanceLedger", "peak_time" : 40, "per_second" : 1 }, { "job_type" : "fetchTxnData", "per_second" : 8 }, { "job_type" : "trustedValidation", "peak_time" : 46, "per_second" : 2 }, { "job_type" : "trustedProposal", "per_second" : 7 }, { "avg_time" : 1, "job_type" : "heartbeat", "peak_time" : 2 }, { "job_type" : "peerCommand", "peak_time" : 3, "per_second" : 586 }, { "job_type" : "processTransaction", "peak_time" : 3, "per_second" : 19 }, { "job_type" : "SyncReadNode", "peak_time" : 1, "per_second" : 118 }, { "job_type" : "AsyncReadNode", "per_second" : 16 }, { "job_type" : "WriteNode", "peak_time" : 9, "per_second" : 111 } ], "threads" : 6 }, "load_factor" : 1, "network_id" : 21337, "node_size" : "medium", "peer_disconnects" : "107", "peer_disconnects_resources" : "0", "peers" : 20, "pubkey_node" : "n9M2wNUJkWF7QriZE6nSH9QeQemaJn2EjVwFjHEAY6dbU5dyV2Y1", "pubkey_validator" : "none", "published_ledger" : 6628849, "server_state" : "full", "server_state_duration_us" : "65258929239", "state_accounting" : { "connected" : { "duration_us" : "31029297", "transitions" : "2" }, "disconnected" : { "duration_us" : "1107554", "transitions" : "2" }, "full" : { "duration_us" : "580524983781", "transitions" : "15" }, "syncing" : { "duration_us" : "47084859", "transitions" : "15" }, "tracking" : { "duration_us" : "23", "transitions" : "15" } }, "time" : "2024-Jul-07 22:33:34.470602 UTC", "uptime" : 580604, "validated_ledger" : { "age" : 3, "base_fee_native" : 1e-05, "base_fee_xrp" : 1e-05, "hash" : "AC9A64275D7308A7C01A15A3ACF10C52B6D476C701ED9B8BF94516DD00AC9BAA", "reserve_base_native" : 1, "reserve_base_xrp" : 1, "reserve_inc_native" : 0.2, "reserve_inc_xrp" : 0.2, "seq" : 6801329 }, "validation_quorum" : 16, "validator_list" : { "count" : 1, "expiration" : "2025-May-07 00:00:00.000000000 UTC", "status" : "active" } }, "native_currency_code" : "XAH", "status" : "success" } }

sudo nginx -t nginx: the configuration file /etc/nginx/nginx.conf syntax is ok nginx: configuration file /etc/nginx/nginx.conf test is successful

wscat -c also works

Any help or suggestions greatly appreciated.

chalith commented 2 weeks ago

Can you share the output of evernode logs?

ObiTwo2 commented 2 weeks ago

Thanks for the response Chalith. Log below: System: 5.4.0-105-generic No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 20.04.6 LTS Release: 20.04 Codename: focal

sa.cfg: { "version": "0.9.0", "hp": { "host_address": "theqau.com", "init_peer_port": 22861, "init_user_port": 26201, "init_gp_tcp_port": 36525, "init_gp_udp_port": 39064 }, "system": { "max_mem_kbytes": 4860000, "max_swap_kbytes": 1670000, "max_cpu_us": 800000, "max_storage_kbytes": 305900000, "max_instance_count": 3 }, "docker": { "registry_port": 4444 }, "log": { "log_level": "inf", "max_mbytes_per_file": 10, "max_file_count": 50, "loggers": [ "console"

    ]

}

} mb-xrpl.cfg: { "version": "0.9.0", "xrpl": { "network": "mainnet", "address": "rranAPabfcgzYUtKcesnpPzb6fPXDryck2", "secretPath": "/home/sashimbxrpl/.evernode-host/.host-account-secret.key", "governorAddress": "rBvKgF3jSZWdJcwSsmoJspoXLLDVLDp6jg", "rippledServer": "wss://wss.xhnode.xyz", "leaseAmount": 0.0001, "affordableExtraFee": 0, "fallbackRippledServers": [] }, "host": { "emailAddress": "removed to avoid spam" } } Sashimono log: -- Logs begin at Tue 2024-07-09 14:12:21 CEST, end at Wed 2024-07-10 11:29:25 CEST. -- -- No entries --

Message board log: ^[[0;1;39mHint: You are currently not seeing messages from other users and the system.^[[0m ^[[0;1;39m Users in groups 'adm', 'systemd-journal' can see all messages.^[[0m ^[[0;1;39m Pass -q to turn off this notice.^[[0m ^[[0;1;31mNo journal files were opened due to insufficient permissions.^[[0m

Reputation and reward system is not enabled.

chalith commented 2 weeks ago

What is the VPS provider you are using?

ObiTwo2 commented 2 weeks ago

Contabo

ObiTwo2 commented 2 weeks ago

I ran the following and noted errors on my Xahau node: tail -f /opt/xahaud/log/debug.log

2024-Jul-15 01:43:58.844659117 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:44:02.090885620 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:44:09.460597211 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:44:13.388314443 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:44:42.694894485 UTC Peer:WRN [093] 172.245.82.87:56112 failed: Ping Timeout 2024-Jul-15 01:44:47.363037436 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:45:00.932886620 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:45:59.055913042 UTC Peer:WRN [096] 51.77.85.218:57692 failed: Ping Timeout 2024-Jul-15 01:46:17.878619344 UTC Peer:WRN [104] onReadMessage from n9MMwZBknuVEsJnFxZVjg7ZzLLiWxjEKP7tpyvaxS7diRYC7qc6B at 62.72.3.144:58284: Connection reset by peer 2024-Jul-15 01:46:18.891948274 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:46:42.766557652 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:46:42.766682548 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:46:57.344584315 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present. 2024-Jul-15 01:46:57.344587701 UTC NetworkOPs:WRN Submitted transaction invalid: EmitDetails present.

Does anyone have a Xahau node I could add one of my hosts (here's the IP 37.60.240.57) to as a test? Should be a quick way to rule out or work out if my Xahau node is the problem.