search

XRPLF / rippled

Decentralized cryptocurrency blockchain daemon implementing the XRP Ledger protocol in C++
https://xrpl.org
ISC License
4.53k stars 1.47k forks source link

(testnet) Synced rippled reports RippledNotInitializedError: Rippled not initialized (Version: 1.7.3 / 1.8.4) #4095

Open nitowa opened 2 years ago

nitowa commented 2 years ago

Issue Description

I am trying to run my rippled in a testnet configuration but even after reporting the sync as success the complete_ledgers value remains 'empty'. The configuration was previously successfully used to run such a node (about 2 years ago) on the machine(s) in question. The behaviour was replicated on a more powerful machine.

The log output suggests the node successfully synchronized and is observing the network.

Steps to Reproduce

run.sh ``` docker run -dit \ --name rippled \ -p 51235:51235 \ -p 6006:6006 \ -p 5005:5005 \ -v $(pwd)/config/:/config/ \ xrpllabsofficial/xrpld:1.7.3 ```
config/rippled.cfg ``` [server] port_peer port_rpc port_ws_public [port_peer] ip=0.0.0.0 port=51235 protocol=peer admin=127.0.0.1 [port_rpc] ip=127.0.0.1 port=5005 protocol=http admin=127.0.0.1 [port_ws_public] ip=0.0.0.0 port=6006 protocol=ws admin=127.0.0.1 [database_path] /data [node_db] type=rocksdb path=/data compression=1 online_delete=4096 advisory_delete=0 open_files=2000 filter_bits=12 cache_mb=256 file_size_mb=8 file_size_mult=2 [network_id] testnet [ips] s.altnet.rippletest.net 51235 [validator_list_sites] https://vl.altnet.rippletest.net [validator_list_keys] ED264807102805220DA0F312E71FC2C69E1552C9C5790F6C25E3729DEB573D5860 [node_size] tiny [ledger_history] 2048 [fetch_depth] full [validation_quorum] 3 [sntp_servers] time.windows.com time.apple.com time.nist.gov pool.ntp.org [rpc_startup] { "command": "log_level", "severity": "info" } [ssl_verify] 0 ```
config/validators.txt ``` [validator_list_sites] https://vl.ripple.com [validator_list_keys] ED2677ABFFD1B33AC6FBC3062B71F1E8397C1505E1C42C64D11AD1B28FF73F4734 ```
docker exec rippled server_info ``` Existing rippled config at host /config/, using them. Loading: "/etc/opt/ripple/rippled.cfg" 2022-Feb-08 17:22:34.310734701 UTC HTTPClient:NFO Connecting to 127.0.0.1:5005 { "result" : { "info" : { "build_version" : "1.7.3", "closed_ledger" : { "age" : 6, "base_fee_xrp" : 1e-05, "hash" : "C7FB022273BA36F5CCF8545FF61A9B116F2F2DE646941AEB5B7F87119D3F3708", "reserve_base_xrp" : 10, "reserve_inc_xrp" : 2, "seq" : 25121751 }, "complete_ledgers" : "empty", "fetch_pack" : 37331, "hostid" : "3baedd83a2dc", "io_latency_ms" : 2442, "jq_trans_overflow" : "0", "last_close" : { "converge_time_s" : 4.762, "proposers" : 6 }, "load" : { "job_types" : [ { "avg_time" : 24, "job_type" : "untrustedValidation", "peak_time" : 309, "per_second" : 5 }, { "in_progress" : 2, "job_type" : "ledgerData", "waiting" : 4 }, { "avg_time" : 11, "in_progress" : 1, "job_type" : "clientCommand", "peak_time" : 347 }, { "avg_time" : 4, "job_type" : "transaction", "peak_time" : 21 }, { "avg_time" : 6, "job_type" : "advanceLedger", "peak_time" : 253, "per_second" : 8 }, { "avg_time" : 25, "job_type" : "trustedValidation", "peak_time" : 305, "per_second" : 1 }, { "job_type" : "writeObjects", "peak_time" : 6, "per_second" : 130 }, { "job_type" : "peerCommand", "peak_time" : 4, "per_second" : 104 }, { "job_type" : "SyncReadNode", "peak_time" : 16, "per_second" : 2469 }, { "job_type" : "AsyncReadNode", "peak_time" : 16, "per_second" : 8583 }, { "job_type" : "WriteNode", "per_second" : 197 } ], "threads" : 4 }, "load_factor" : 1, "peer_disconnects" : "149", "peer_disconnects_resources" : "0", "peers" : 12, "pubkey_node" : "n9J5Lf6DsYisnknL9YUYi3sjMaguddvTrprYmmPq7tvwD5hBp9r7", "pubkey_validator" : "none", "published_ledger" : "none", "server_state" : "full", "server_state_duration_us" : "16199530", "state_accounting" : { "connected" : { "duration_us" : "2686664154", "transitions" : 88 }, "disconnected" : { "duration_us" : "1165273", "transitions" : 2 }, "full" : { "duration_us" : "17591237213", "transitions" : 87 }, "syncing" : { "duration_us" : "0", "transitions" : 0 }, "tracking" : { "duration_us" : "43813026", "transitions" : 52 } }, "time" : "2022-Feb-08 17:22:37.786857 UTC", "uptime" : 20322, "validation_quorum" : 32, "validator_list" : { "count" : 2, "expiration" : "2022-May-24 00:00:00.000000000 UTC", "status" : "active" } }, "status" : "success" } } ```
docker logs -n 50 rippled ``` 2022-Feb-08 17:23:40.145586115 UTC NetworkOPs:NFO Consensus time for #25121773 with LCL B8C9E70DC4C84B02542A9292B20245D51E181A0EE97ADB8D380E898EE87B22D1 2022-Feb-08 17:23:40.145817442 UTC LedgerConsensus:NFO Entering consensus process, watching, synced=yes 2022-Feb-08 17:23:40.146163268 UTC LedgerConsensus:NFO Consensus mode change before=switchedLedger, after=observing 2022-Feb-08 17:23:41.166912000 UTC LoadMonitor:WRN Job: InboundLedger run: 2944ms wait: 122ms 2022-Feb-08 17:23:41.173317114 UTC LoadMonitor:WRN Job: processLedgerData run: 6ms wait: 2816ms 2022-Feb-08 17:23:42.138927008 UTC LedgerConsensus:NFO Proposers:6 nw:50 thrV:3 thrC:4 2022-Feb-08 17:23:42.139369714 UTC LedgerConsensus:NFO Converge cutoff (6 participants) 2022-Feb-08 17:23:42.141892477 UTC LedgerConsensus:NFO CNF buildLCL 0FDECB562F54B0D1920526AE03E138BFFA1AF8F9DA8DF1BEDADB7B1F0F523617 2022-Feb-08 17:23:42.142589233 UTC LedgerConsensus:NFO We closed at 697656220 2022-Feb-08 17:23:42.142619007 UTC LedgerConsensus:NFO 3 time votes for 697656216 2022-Feb-08 17:23:42.142627336 UTC LedgerConsensus:NFO 3 time votes for 697656217 2022-Feb-08 17:23:42.142650464 UTC LedgerConsensus:NFO Our close offset is estimated at -3 (7) 2022-Feb-08 17:23:42.142677660 UTC TimeKeeper:NFO TimeKeeper: Close time offset now -1 2022-Feb-08 17:23:42.143618745 UTC NetworkOPs:NFO Consensus time for #25121774 with LCL 0FDECB562F54B0D1920526AE03E138BFFA1AF8F9DA8DF1BEDADB7B1F0F523617 2022-Feb-08 17:23:42.143940022 UTC LedgerConsensus:NFO Entering consensus process, watching, synced=yes 2022-Feb-08 17:23:42.143988419 UTC LedgerConsensus:NFO Consensus mode change before=observing, after=observing 2022-Feb-08 17:23:42.713626182 UTC Application:NFO Transaction DB pathname: /data/transaction.db; file size: 4096 bytes; SQLite page size: 4096 bytes; Free pages: 2147483638; Free space: 8796092981248 bytes; Note that this does not take into account available disk space. 2022-Feb-08 17:23:44.116133784 UTC LoadMonitor:WRN Job: sweep run: 1403ms wait: 5ms 2022-Feb-08 17:23:45.672559110 UTC LedgerConsensus:NFO Proposers:6 nw:65 thrV:4 thrC:4 2022-Feb-08 17:23:45.673036999 UTC LedgerConsensus:NFO Converge cutoff (6 participants) 2022-Feb-08 17:23:45.673878074 UTC LedgerConsensus:NFO CNF buildLCL 5121576018F1AD5EAE041A7CFD0EDF11DC6E492087BCF88F4DED8AB16EBFAF06 2022-Feb-08 17:23:45.674244883 UTC LedgerConsensus:NFO We closed at 697656221 2022-Feb-08 17:23:45.674268678 UTC LedgerConsensus:NFO 3 time votes for 697656219 2022-Feb-08 17:23:45.674286437 UTC LedgerConsensus:NFO 3 time votes for 697656220 2022-Feb-08 17:23:45.674296903 UTC LedgerConsensus:NFO Our close offset is estimated at -1 (7) 2022-Feb-08 17:23:45.674506918 UTC NetworkOPs:NFO Consensus time for #25121775 with LCL 5121576018F1AD5EAE041A7CFD0EDF11DC6E492087BCF88F4DED8AB16EBFAF06 2022-Feb-08 17:23:45.674659473 UTC LedgerConsensus:NFO Entering consensus process, watching, synced=yes 2022-Feb-08 17:23:45.674679921 UTC LedgerConsensus:NFO Consensus mode change before=observing, after=observing 2022-Feb-08 17:23:46.258221523 UTC LoadMonitor:WRN Job: processLedgerData run: 5084ms wait: 2815ms 2022-Feb-08 17:23:46.259467906 UTC LoadMonitor:WRN Job: InboundLedger run: 1ms wait: 7566ms 2022-Feb-08 17:23:46.662221562 UTC LoadMonitor:WRN Job: processLedgerData run: 8102ms wait: 236ms 2022-Feb-08 17:23:46.663176489 UTC LoadMonitor:WRN Job: processLedgerData run: 1ms wait: 7640ms 2022-Feb-08 17:23:49.685544695 UTC LoadMonitor:WRN Job: processLedgerData run: 3426ms wait: 7364ms 2022-Feb-08 17:23:50.090378759 UTC LedgerConsensus:NFO Proposers:6 nw:65 thrV:4 thrC:4 2022-Feb-08 17:23:50.090501454 UTC LedgerConsensus:NFO Position change: CTime 697656220, tx 642635D79F793651D3F217CEE8939C5FAFF36AE35FBB593AD5789250144196DE 2022-Feb-08 17:23:50.091463869 UTC LedgerConsensus:NFO Converge cutoff (6 participants) 2022-Feb-08 17:23:50.093578187 UTC LedgerConsensus:NFO CNF buildLCL 2E3CE9B036BDC1BB133159F42076FBE72E495EA476A8EFF7F08C2DD1A18BC399 2022-Feb-08 17:23:50.095766451 UTC LedgerConsensus:NFO We closed at 697656226 2022-Feb-08 17:23:50.095803332 UTC LedgerConsensus:NFO 5 time votes for 697656223 2022-Feb-08 17:23:50.095817916 UTC LedgerConsensus:NFO 1 time votes for 697656224 2022-Feb-08 17:23:50.095832723 UTC LedgerConsensus:NFO Our close offset is estimated at -2 (7) 2022-Feb-08 17:23:50.095846810 UTC TimeKeeper:NFO TimeKeeper: Close time offset now -1 2022-Feb-08 17:23:50.096221163 UTC NetworkOPs:NFO Consensus time for #25121776 with LCL 2E3CE9B036BDC1BB133159F42076FBE72E495EA476A8EFF7F08C2DD1A18BC399 2022-Feb-08 17:23:50.096416112 UTC LedgerConsensus:NFO Entering consensus process, watching, synced=yes 2022-Feb-08 17:23:50.096488596 UTC LedgerConsensus:NFO Consensus mode change before=observing, after=observing 2022-Feb-08 17:23:51.397530897 UTC LoadMonitor:WRN Job: processLedgerData run: 4734ms wait: 7001ms 2022-Feb-08 17:23:51.397754329 UTC LoadMonitor:WRN Job: AcquisitionDone run: 0ms wait: 10224ms 2022-Feb-08 17:23:51.398664087 UTC LoadMonitor:WRN Job: processLedgerData run: 1ms wait: 8677ms 2022-Feb-08 17:23:51.399391187 UTC LoadMonitor:WRN Job: processLedgerData run: 1ms wait: 5451ms 2022-Feb-08 17:23:51.399495798 UTC LoadMonitor:WRN Job: AcquisitionDone run: 0ms wait: 4736ms ```

Expected Result

The server holds information of the last 2048 ledgers that can be queried via websocket.

Actual Result

RippledNotInitializedError: Rippled not initialized

Environment

rippled 1.7.3 or 1.8.4

Machine large:

Machine small:

intelliot commented 1 year ago

@nitowa is this still an issue? Can you see if the problem still occurs with rippled 1.10.1?