search

dymensionxyz / dymint

Sequencing Engine for Dymension RollApps
Other
96 stars 67 forks source link

seg fault v1.1.3-hotfix.1 #948

Open danwt opened 2 months ago

danwt commented 2 months ago

This needs some investigation as there could be more than one thing happening here

In an execution there are two panics

  1. inside celestia LC. Before this everything was fine. After this the node can't process tx's anymore.
  2. 9 hrs later

https://pastebin.com/raw/d4nqYptk

danwt commented 1 month ago

2024-07-09 00:48:07.161 time="2024-07-08T23:48:07Z" level=info msg="burned tokens from module account[amount 640000000000000000acnx from evm]" module=x/bank 2024-07-09 00:48:07.161 time="2024-07-08T23:48:07Z" level=info msg="minted coins from module account[amount 640000000000000000acnx from evm]" module=x/bank 2024-07-09 00:48:07.242 time="2024-07-08T23:48:07Z" level=info msg="commit synced[commit 436F6D6D697449447B5B3131342031363320313939203132382038312039392031383720323233203136382031353120313635203137372031373520393920323433203139302034392031393220313833203734203130332033332032303720373920323530203234203233342031373920323032203137203635203133325D3A3446393646367D]" 2024-07-09 00:48:07.243 time="2024-07-08T23:48:07Z" level=info msg="Block created.[height 5215990 num_tx 2]" module=BlockManager 2024-07-09 00:48:09.000 time="2024-07-08T23:48:09Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 00:48:09.499 time="2024-07-08T23:48:09Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 00:48:09.499 context canceled 2024-07-09 00:48:09.499 2024-07-08T23:48:09.499Z WARN rpc go-jsonrpc@v0.3.1/handler.go:444 error in RPC call to 'blob.Included': failed to open stream: context canceled 2024-07-09 00:48:09.499 context canceled 2024-07-09 00:48:09.499 2024-07-08T23:48:09.499Z WARN rpc go-jsonrpc@v0.3.1/handler.go:444 error in RPC call to 'blob.Included': failed to open stream: context canceled 2024-07-09 00:48:09.599 2024-07-08T23:48:09.599Z INFO header/store store/store.go:375 new head {"height": 1433857, "hash": "0BCAFB1568C111F9122FF901986C2937A3B978AC86AD43FE82582614C747880D"} 2024-07-09 00:48:09.599 2024-07-08T23:48:09.599Z INFO header/store store/store.go:375 new head {"height": 1433857, "hash": "0BCAFB1568C111F9122FF901986C2937A3B978AC86AD43FE82582614C747880D"} 2024-07-09 00:48:09.599 2024-07-08T23:48:09.599Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433857, "hash": "0BCAFB1568C111F9122FF901986C2937A3B978AC86AD43FE82582614C747880D", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000021177} 2024-07-09 00:48:09.599 2024-07-08T23:48:09.599Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433857, "hash": "0BCAFB1568C111F9122FF901986C2937A3B978AC86AD43FE82582614C747880D", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000021177} 2024-07-09 00:48:11.428 2024-07-08T23:48:11.428Z ERROR share/light light/availability.go:146 availability validation failed {"root": "46A09D3056E6229D68850AE4F4E830CD0D86C2A12C364039AC11211D3F46D7EE", "failed_samples": [{"Row":14,"Col":4},{"Row":6,"Col":11}]} 2024-07-09 00:48:11.428 2024-07-08T23:48:11.428Z ERROR share/light light/availability.go:146 availability validation failed {"root": "46A09D3056E6229D68850AE4F4E830CD0D86C2A12C364039AC11211D3F46D7EE", "failed_samples": [{"Row":14,"Col":4},{"Row":6,"Col":11}]} 2024-07-09 00:48:11.429 2024-07-08T23:48:11.428Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433823, "to": 1433823, "errors": 1, "finished (s)": 160.000690772} 2024-07-09 00:48:11.429 2024-07-08T23:48:11.428Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433823, "to": 1433823, "errors": 1, "finished (s)": 160.000690772} 2024-07-09 00:48:12.212 {"level":"debug","ts":"2024-07-08T23:48:12.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:48:12.212 {"level":"debug","ts":"2024-07-08T23:48:12.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:48:12.502 2024-07-08T23:48:12.502Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:48:12.502 2024-07-08T23:48:12.502Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:48:14.501 2024-07-08T23:48:14.500Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:48:14.501 2024-07-08T23:48:14.500Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:48:15.287 2024-07-08T23:48:15.287Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433348, "to": 1433348, "errors": 0, "finished (s)": 3.858879968} 2024-07-09 00:48:15.287 2024-07-08T23:48:15.287Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433348, "to": 1433348, "errors": 0, "finished (s)": 3.858879968} 2024-07-09 00:48:20.804 2024-07-08T23:48:20.804Z INFO header/store store/store.go:375 new head {"height": 1433858, "hash": "E1047F0D11516184BC09022C17730631ECB4396E4F6253A35E92C8EEFA412764"} 2024-07-09 00:48:20.804 2024-07-08T23:48:20.804Z INFO header/store store/store.go:375 new head {"height": 1433858, "hash": "E1047F0D11516184BC09022C17730631ECB4396E4F6253A35E92C8EEFA412764"} 2024-07-09 00:48:20.805 2024-07-08T23:48:20.804Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433858, "hash": "E1047F0D11516184BC09022C17730631ECB4396E4F6253A35E92C8EEFA412764", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000010732} 2024-07-09 00:48:20.805 2024-07-08T23:48:20.804Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433858, "hash": "E1047F0D11516184BC09022C17730631ECB4396E4F6253A35E92C8EEFA412764", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000010732} 2024-07-09 00:48:22.221 2024-07-08T23:48:22.221Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433850, "hash": "408703549D384E1862815CB2A10725A54FECB38990EFD30264B7429E75C88624", "square width": 16, "data root": "280D5A8385A4FD82B78264F4A848A053AE3B08D485151BEB09A3D7F1B1C0A1B3", "finished (s)": 91.373699595} 2024-07-09 00:48:22.221 2024-07-08T23:48:22.221Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433850, "hash": "408703549D384E1862815CB2A10725A54FECB38990EFD30264B7429E75C88624", "square width": 16, "data root": "280D5A8385A4FD82B78264F4A848A053AE3B08D485151BEB09A3D7F1B1C0A1B3", "finished (s)": 91.373699595} 2024-07-09 00:48:22.650 2024-07-08T23:48:22.649Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433788, "to": 1433788, "errors": 1, "finished (s)": 160.000729217} 2024-07-09 00:48:22.650 2024-07-08T23:48:22.649Z ERROR share/light light/availability.go:146 availability validation failed {"root": "EA75EC54F69A8CBB909CF3DA83D553AAED96F1CFE964CB0D2476425716F16DEC", "failed_samples": [{"Row":3,"Col":7}]} 2024-07-09 00:48:22.650 2024-07-08T23:48:22.649Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433788, "to": 1433788, "errors": 1, "finished (s)": 160.000729217} 2024-07-09 00:48:22.650 2024-07-08T23:48:22.649Z ERROR share/light light/availability.go:146 availability validation failed {"root": "EA75EC54F69A8CBB909CF3DA83D553AAED96F1CFE964CB0D2476425716F16DEC", "failed_samples": [{"Row":3,"Col":7}]} 2024-07-09 00:48:32.035 2024-07-08T23:48:32.035Z INFO header/store store/store.go:375 new head {"height": 1433859, "hash": "4CD6969680EF7196406ED93DAAE2A02033F30486912F5BC24B26052E9F484339"} 2024-07-09 00:48:32.035 2024-07-08T23:48:32.035Z INFO header/store store/store.go:375 new head {"height": 1433859, "hash": "4CD6969680EF7196406ED93DAAE2A02033F30486912F5BC24B26052E9F484339"} 2024-07-09 00:48:40.319 2024-07-08T23:48:40.319Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433859, "hash": "4CD6969680EF7196406ED93DAAE2A02033F30486912F5BC24B26052E9F484339", "square width": 16, "data root": "8828F467D78D07F7CCCC6E43E27DA3F37740D23BF04FD153C03EA945A4A2F268", "finished (s)": 8.283373518} 2024-07-09 00:48:40.319 2024-07-08T23:48:40.319Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433859, "hash": "4CD6969680EF7196406ED93DAAE2A02033F30486912F5BC24B26052E9F484339", "square width": 16, "data root": "8828F467D78D07F7CCCC6E43E27DA3F37740D23BF04FD153C03EA945A4A2F268", "finished (s)": 8.283373518} 2024-07-09 00:48:42.212 {"level":"debug","ts":"2024-07-08T23:48:42.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:48:42.212 {"level":"debug","ts":"2024-07-08T23:48:42.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:48:43.765 2024-07-08T23:48:43.765Z INFO header/store store/store.go:375 new head {"height": 1433860, "hash": "02382808F7A932E978D08129397A4E82DD23A93BFD16A49DAE96EA3106A8771F"} 2024-07-09 00:48:43.765 2024-07-08T23:48:43.765Z INFO header/store store/store.go:375 new head {"height": 1433860, "hash": "02382808F7A932E978D08129397A4E82DD23A93BFD16A49DAE96EA3106A8771F"} 2024-07-09 00:48:43.766 2024-07-08T23:48:43.765Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433860, "hash": "02382808F7A932E978D08129397A4E82DD23A93BFD16A49DAE96EA3106A8771F", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000009944} 2024-07-09 00:48:43.766 2024-07-08T23:48:43.765Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433860, "hash": "02382808F7A932E978D08129397A4E82DD23A93BFD16A49DAE96EA3106A8771F", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000009944} 2024-07-09 00:48:45.792 2024-07-08T23:48:45.792Z ERROR share/light light/availability.go:146 availability validation failed {"root": "674E61DCCF424AB59C315A829C5B1E8FC7A44E6F80E9CFD38893F9D7BDF2A157", "failed_samples": [{"Row":35,"Col":26},{"Row":35,"Col":15},{"Row":10,"Col":13}]} 2024-07-09 00:48:45.792 2024-07-08T23:48:45.791Z ERROR share/light light/availability.go:146 availability validation failed {"root": "2882EA008FD5B4A09E8721D5A4AD80EF00CFE1EB5F53EEB7F3F7334A08D3DD6E", "failed_samples": [{"Row":102,"Col":47},{"Row":12,"Col":119},{"Row":0,"Col":101}]} 2024-07-09 00:48:45.792 2024-07-08T23:48:45.792Z ERROR share/light light/availability.go:146 availability validation failed {"root": "674E61DCCF424AB59C315A829C5B1E8FC7A44E6F80E9CFD38893F9D7BDF2A157", "failed_samples": [{"Row":35,"Col":26},{"Row":35,"Col":15},{"Row":10,"Col":13}]} 2024-07-09 00:48:45.792 2024-07-08T23:48:45.791Z ERROR share/light light/availability.go:146 availability validation failed {"root": "2882EA008FD5B4A09E8721D5A4AD80EF00CFE1EB5F53EEB7F3F7334A08D3DD6E", "failed_samples": [{"Row":102,"Col":47},{"Row":12,"Col":119},{"Row":0,"Col":101}]} 2024-07-09 00:48:45.792 2024-07-08T23:48:45.792Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433790, "to": 1433790, "errors": 1, "finished (s)": 160.000253654} 2024-07-09 00:48:45.792 2024-07-08T23:48:45.792Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433790, "to": 1433790, "errors": 1, "finished (s)": 160.000253654} 2024-07-09 00:48:51.549 2024-07-08T23:48:51.549Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: Application error 0x0 (remote) 2024-07-09 00:48:51.549 2024-07-08T23:48:51.549Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: Application error 0x0 (remote) 2024-07-09 00:48:52.150 2024-07-08T23:48:52.150Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433855, "hash": "AC7DAA9F1DA3C25C69E5425B683B32CA8F074367648B0E103B886A7200BACA0E", "square width": 8, "data root": "2F9E04FA6AF24FE9E07EA68608EDA943F9BAAE7C70EAE755CC1432D3E360428D", "finished (s)": 65.140016236} 2024-07-09 00:48:52.150 2024-07-08T23:48:52.150Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433855, "hash": "AC7DAA9F1DA3C25C69E5425B683B32CA8F074367648B0E103B886A7200BACA0E", "square width": 8, "data root": "2F9E04FA6AF24FE9E07EA68608EDA943F9BAAE7C70EAE755CC1432D3E360428D", "finished (s)": 65.140016236} 2024-07-09 00:48:52.612 2024-07-08T23:48:52.612Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: Application error 0x0 (remote) 2024-07-09 00:48:52.612 2024-07-08T23:48:52.612Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: Application error 0x0 (remote) 2024-07-09 00:48:54.736 2024-07-08T23:48:54.736Z INFO header/store store/store.go:375 new head {"height": 1433861, "hash": "6892DF1DBCC3F793E900B7E2695E4BAC768EAA20A2868FE73DB7F96CD623CABA"} 2024-07-09 00:48:54.736 2024-07-08T23:48:54.736Z INFO header/store store/store.go:375 new head {"height": 1433861, "hash": "6892DF1DBCC3F793E900B7E2695E4BAC768EAA20A2868FE73DB7F96CD623CABA"} 2024-07-09 00:48:54.736 2024-07-08T23:48:54.736Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433861, "hash": "6892DF1DBCC3F793E900B7E2695E4BAC768EAA20A2868FE73DB7F96CD623CABA", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000009608} 2024-07-09 00:48:54.736 2024-07-08T23:48:54.736Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433861, "hash": "6892DF1DBCC3F793E900B7E2695E4BAC768EAA20A2868FE73DB7F96CD623CABA", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000009608} 2024-07-09 00:48:55.000 time="2024-07-08T23:48:55Z" level=error msg="failed to broadcast tx[error invalid nonce; got 19364, expected 19365: invalid sequence: invalid sequence]" module=backend 2024-07-09 00:48:55.000 time="2024-07-08T23:48:55Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.85:22808 reqid 203 duration 1.423332ms err invalid nonce; got 19364, expected 19365: invalid sequence: invalid sequence]" module=geth 2024-07-09 00:48:55.000 time="2024-07-08T23:48:55Z" level=info msg="rejected bad transaction[priority 0 tx 5F337A11F006F7B4C0BE1C2A3AF562DE70253F13F669E6E2771C0D5AAE27004D peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 00:48:55.689 time="2024-07-08T23:48:55Z" level=error msg="failed to broadcast tx[error invalid nonce; got 19364, expected 19365: invalid sequence: invalid sequence]" module=backend 2024-07-09 00:48:55.689 time="2024-07-08T23:48:55Z" level=info msg="rejected bad transaction[priority 0 tx 5F337A11F006F7B4C0BE1C2A3AF562DE70253F13F669E6E2771C0D5AAE27004D peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 00:48:55.689 time="2024-07-08T23:48:55Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.85:22808 reqid 203 duration 1.423332ms err invalid nonce; got 19364, expected 19365: invalid sequence: invalid sequence]" module=geth 2024-07-09 00:48:56.615 2024-07-08T23:48:56.615Z ERROR share/light light/availability.go:146 availability validation failed {"root": "84D565119C6AC9CCA2A6F7BB8734CBA564276BAA6E48B1A136CD0F920EB10766", "failed_samples": [{"Row":55,"Col":73},{"Row":14,"Col":48},{"Row":41,"Col":1}]} 2024-07-09 00:48:56.615 2024-07-08T23:48:56.615Z ERROR share/light light/availability.go:146 availability validation failed {"root": "84D565119C6AC9CCA2A6F7BB8734CBA564276BAA6E48B1A136CD0F920EB10766", "failed_samples": [{"Row":55,"Col":73},{"Row":14,"Col":48},{"Row":41,"Col":1}]} 2024-07-09 00:48:56.616 2024-07-08T23:48:56.615Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433827, "to": 1433827, "errors": 1, "finished (s)": 160.000607403} 2024-07-09 00:48:56.616 2024-07-08T23:48:56.615Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433827, "to": 1433827, "errors": 1, "finished (s)": 160.000607403} 2024-07-09 00:48:56.909 2024-07-08T23:48:56.909Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: stream reset 2024-07-09 00:48:56.909 2024-07-08T23:48:56.909Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: stream reset 2024-07-09 00:49:01.193 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:49:01.194 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:49:01.194 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:49:01.194 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:49:01.195 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:49:01.195 (ubuntu) CMD (/usr/local/sbin/celestia_balances.sh) 2024-07-09 00:49:01.195 (ubuntu) CMD (/usr/local/sbin/dymd_version.sh) 2024-07-09 00:49:01.195 (ubuntu) CMD (/usr/local/sbin/sequencer_balances.sh) 2024-07-09 00:49:01.195 (ubuntu) CMD (/usr/local/sbin/rollappd_version.sh) 2024-07-09 00:49:01.195 (ubuntu) CMD (/usr/local/sbin/celestia_version.sh) 2024-07-09 00:49:01.196 (CRON) info (No MTA installed, discarding output) 2024-07-09 00:49:01.196 (CRON) info (No MTA installed, discarding output) 2024-07-09 00:49:01.196 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:49:01.196 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:49:01.263 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:49:01.280 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:49:01.288 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:49:05.941 2024-07-08T23:49:05.941Z INFO header/store store/store.go:375 new head {"height": 1433862, "hash": "1339783CF446326EB438C428C7876E4D184BEBDD9523600962F77FCB205D66F3"} 2024-07-09 00:49:05.941 2024-07-08T23:49:05.941Z INFO header/store store/store.go:375 new head {"height": 1433862, "hash": "1339783CF446326EB438C428C7876E4D184BEBDD9523600962F77FCB205D66F3"} 2024-07-09 00:49:05.941 2024-07-08T23:49:05.941Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433862, "hash": "1339783CF446326EB438C428C7876E4D184BEBDD9523600962F77FCB205D66F3", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000007828} 2024-07-09 00:49:05.941 2024-07-08T23:49:05.941Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433862, "hash": "1339783CF446326EB438C428C7876E4D184BEBDD9523600962F77FCB205D66F3", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000007828} 2024-07-09 00:49:08.025 2024-07-08T23:49:08.025Z ERROR share/light light/availability.go:146 availability validation failed {"root": "40EBB8B5F837BFB55AFD9B28B93B9B061724B3F4EDA9FFC90EA27801549F1B7E", "failed_samples": [{"Row":1,"Col":1}]} 2024-07-09 00:49:08.025 2024-07-08T23:49:08.025Z ERROR share/light light/availability.go:146 availability validation failed {"root": "40EBB8B5F837BFB55AFD9B28B93B9B061724B3F4EDA9FFC90EA27801549F1B7E", "failed_samples": [{"Row":1,"Col":1}]} 2024-07-09 00:49:08.025 2024-07-08T23:49:08.025Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433792, "to": 1433792, "errors": 1, "finished (s)": 160.000166437} 2024-07-09 00:49:08.025 2024-07-08T23:49:08.025Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433792, "to": 1433792, "errors": 1, "finished (s)": 160.000166437} 2024-07-09 00:49:08.314 2024-07-08T23:49:08.314Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433706, "to": 1433706, "errors": 0, "finished (s)": 2.373308966} 2024-07-09 00:49:08.314 2024-07-08T23:49:08.314Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433706, "to": 1433706, "errors": 0, "finished (s)": 2.373308966} 2024-07-09 00:49:12.212 {"level":"debug","ts":"2024-07-08T23:49:12.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:49:12.212 {"level":"debug","ts":"2024-07-08T23:49:12.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:49:12.576 2024-07-08T23:49:12.576Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: Application error 0x0 (remote) 2024-07-09 00:49:12.576 2024-07-08T23:49:12.576Z INFO bitswap-server server/server.go:547 Bitswap Client ReceiveError: Application error 0x0 (remote) 2024-07-09 00:49:14.000 time="2024-07-08T23:49:14Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 00:49:14.500 time="2024-07-08T23:49:14Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/blob/service.go:241 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/nodebuilder/blob/blob.go:74 2024-07-09 00:49:14.501 /usr/local/go/src/runtime/signal_unix.go:881 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/p2p/peers.(Manager).newPeer.(Manager).doneFunc.func1 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/cascade.go:88 2024-07-09 00:49:14.501 reflect.Value.Call 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.(CascadeGetter).GetSharesByNamespace 2024-07-09 00:49:14.501 runtime.gopanic 2024-07-09 00:49:14.501 github.com/filecoin-project/go-jsonrpc.doCall.func1 2024-07-09 00:49:14.501 reflect.Value.call 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/blob.(Service).Included 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/blob/service.go:287 2024-07-09 00:49:14.501 github.com/filecoin-project/go-jsonrpc/auth.PermissionedProxy.func1 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/shrex.go:249 2024-07-09 00:49:14.501 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/auth/auth.go:62 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.(ShrexGetter).GetSharesByNamespace 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/cascade.go:85 2024-07-09 00:49:14.501 /usr/local/go/src/reflect/value.go:596 2024-07-09 00:49:14.501 /usr/local/go/src/reflect/value.go:380 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/nodebuilder/blob.(API).Included 2024-07-09 00:49:14.501 2024-07-08T23:49:14.501Z ERROR rpc go-jsonrpc@v0.3.1/handler.go:276 panic in rpc method 'blob.Included': runtime error: invalid memory address or nil pointer dereference 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/p2p/peers/manager.go:283 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/blob.(Service).retrieve 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.(CascadeGetter).GetSharesByNamespace.func1 2024-07-09 00:49:14.501 runtime.sigpanic 2024-07-09 00:49:14.501 /usr/local/go/src/runtime/panic.go:261 2024-07-09 00:49:14.501 runtime.panicmem 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.cascadeGetters[...] 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/cascade.go:129 2024-07-09 00:49:14.501 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:276 2024-07-09 00:49:14.501 /usr/local/go/src/runtime/panic.go:770 2024-07-09 00:49:14.501 github.com/filecoin-project/go-jsonrpc.doCall 2024-07-09 00:49:14.501 reflect.Value.Call 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/nodebuilder/blob/blob.go:74 2024-07-09 00:49:14.501 github.com/filecoin-project/go-jsonrpc.doCall 2024-07-09 00:49:14.501 runtime.gopanic 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/cascade.go:85 2024-07-09 00:49:14.501 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/auth/auth.go:62 2024-07-09 00:49:14.501 /usr/local/go/src/runtime/signal_unix.go:881 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/cascade.go:129 2024-07-09 00:49:14.501 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:276 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/cascade.go:88 2024-07-09 00:49:14.501 /usr/local/go/src/reflect/value.go:596 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/blob/service.go:287 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/nodebuilder/blob.(API).Included 2024-07-09 00:49:14.501 /usr/local/go/src/runtime/panic.go:261 2024-07-09 00:49:14.501 /usr/local/go/src/runtime/panic.go:770 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/blob.(Service).Included 2024-07-09 00:49:14.501 reflect.Value.call 2024-07-09 00:49:14.501 runtime.sigpanic 2024-07-09 00:49:14.501 github.com/filecoin-project/go-jsonrpc/auth.PermissionedProxy.func1 2024-07-09 00:49:14.501 2024-07-08T23:49:14.501Z ERROR rpc go-jsonrpc@v0.3.1/handler.go:276 panic in rpc method 'blob.Included': runtime error: invalid memory address or nil pointer dereference 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.(ShrexGetter).GetSharesByNamespace 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/p2p/peers/manager.go:283 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/p2p/peers.(Manager).newPeer.(Manager).doneFunc.func1 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.(CascadeGetter).GetSharesByNamespace.func1 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/blob.(Service).retrieve 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/blob/service.go:241 2024-07-09 00:49:14.501 github.com/filecoin-project/go-jsonrpc.doCall.func1 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.cascadeGetters[...] 2024-07-09 00:49:14.501 /home/ubuntu/celestia-node/share/getters/shrex.go:249 2024-07-09 00:49:14.501 github.com/celestiaorg/celestia-node/share/getters.(CascadeGetter).GetSharesByNamespace 2024-07-09 00:49:14.501 /usr/local/go/src/reflect/value.go:380 2024-07-09 00:49:14.501 runtime.panicmem 2024-07-09 00:49:14.502 net/http.(conn).serve 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:268 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc.(handler).handle 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:424 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc.(RPCServer).ServeHTTP 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc.(handler).handleReader 2024-07-09 00:49:14.502 /usr/local/go/src/net/http/server.go:2039 2024-07-09 00:49:14.502 2024-07-08T23:49:14.501Z WARN rpc go-jsonrpc@v0.3.1/server.go:118 rpc error: fatal error calling 'blob.Included': panic in rpc method 'blob.Included': runtime error: invalid memory address or nil pointer dereference 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/auth/handler.go:47 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc/auth.(Handler).ServeHTTP 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:280 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/server.go:104 2024-07-09 00:49:14.502 /usr/local/go/src/net/http/server.go:3137 2024-07-09 00:49:14.502 net/http.serverHandler.ServeHTTP 2024-07-09 00:49:14.502 2024-07-08T23:49:14.501Z ERROR rpc go-jsonrpc@v0.3.1/server.go:108 RPC Error: fatal error calling 'blob.Included': panic in rpc method 'blob.Included': runtime error: invalid memory address or nil pointer dereference 2024-07-09 00:49:14.502 /usr/local/go/src/net/http/server.go:3137 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:424 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/auth/handler.go:47 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/server.go:104 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:280 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc.(handler).handle 2024-07-09 00:49:14.502 /usr/local/go/src/net/http/server.go:2039 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc/auth.(Handler).ServeHTTP 2024-07-09 00:49:14.502 net/http.(conn).serve 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc.(RPCServer).ServeHTTP 2024-07-09 00:49:14.502 /home/ubuntu/go/pkg/mod/github.com/filecoin-project/go-jsonrpc@v0.3.1/handler.go:268 2024-07-09 00:49:14.502 github.com/filecoin-project/go-jsonrpc.(handler).handleReader 2024-07-09 00:49:14.502 2024-07-08T23:49:14.501Z ERROR rpc go-jsonrpc@v0.3.1/server.go:108 RPC Error: fatal error calling 'blob.Included': panic in rpc method 'blob.Included': runtime error: invalid memory address or nil pointer dereference 2024-07-09 00:49:14.502 net/http.serverHandler.ServeHTTP 2024-07-09 00:49:14.502 2024-07-08T23:49:14.501Z WARN rpc go-jsonrpc@v0.3.1/server.go:118 rpc error: fatal error calling 'blob.Included': panic in rpc method 'blob.Included': runtime error: invalid memory address or nil pointer dereference 2024-07-09 00:49:17.350 2024-07-08T23:49:17.350Z INFO header/store store/store.go:375 new head {"height": 1433863, "hash": "087A768A24EE80FD5B5FC33E26439F2C29E5EE1F564E8400E0486138F7B511C5"} 2024-07-09 00:49:17.350 2024-07-08T23:49:17.350Z INFO header/store store/store.go:375 new head {"height": 1433863, "hash": "087A768A24EE80FD5B5FC33E26439F2C29E5EE1F564E8400E0486138F7B511C5"} 2024-07-09 00:49:17.350 2024-07-08T23:49:17.350Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433863, "hash": "087A768A24EE80FD5B5FC33E26439F2C29E5EE1F564E8400E0486138F7B511C5", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000008886} 2024-07-09 00:49:17.350 2024-07-08T23:49:17.350Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433863, "hash": "087A768A24EE80FD5B5FC33E26439F2C29E5EE1F564E8400E0486138F7B511C5", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000008886} 2024-07-09 00:49:17.503 2024-07-08T23:49:17.503Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:49:17.503 2024-07-08T23:49:17.503Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:49:17.935 2024-07-08T23:49:17.935Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:49:17.935 2024-07-08T23:49:17.935Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:49:28.567 2024-07-08T23:49:28.567Z INFO header/store store/store.go:375 new head {"height": 1433864, "hash": "C5BB2EC3415CBB211EEDF459764710D585F784B0FBDAFA0699BF60CD4E345A05"} 2024-07-09 00:49:28.567 2024-07-08T23:49:28.567Z INFO header/store store/store.go:375 new head {"height": 1433864, "hash": "C5BB2EC3415CBB211EEDF459764710D585F784B0FBDAFA0699BF60CD4E345A05"} 2024-07-09 00:49:28.568 2024-07-08T23:49:28.568Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433864, "hash": "C5BB2EC3415CBB211EEDF459764710D585F784B0FBDAFA0699BF60CD4E345A05", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.00000795} 2024-07-09 00:49:28.568 2024-07-08T23:49:28.568Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433864, "hash": "C5BB2EC3415CBB211EEDF459764710D585F784B0FBDAFA0699BF60CD4E345A05", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.00000795} 2024-07-09 00:49:39.763 2024-07-08T23:49:39.763Z INFO header/store store/store.go:375 new head {"height": 1433865, "hash": "C1C1510C345E519E02B883C86E91ACBE9340012A30DCFD2C1DA8796A4EB2FAC7"} 2024-07-09 00:49:39.763 2024-07-08T23:49:39.763Z INFO header/store store/store.go:375 new head {"height": 1433865, "hash": "C1C1510C345E519E02B883C86E91ACBE9340012A30DCFD2C1DA8796A4EB2FAC7"} 2024-07-09 00:49:39.764 2024-07-08T23:49:39.763Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433865, "hash": "C1C1510C345E519E02B883C86E91ACBE9340012A30DCFD2C1DA8796A4EB2FAC7", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000010757} 2024-07-09 00:49:39.764 2024-07-08T23:49:39.763Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433865, "hash": "C1C1510C345E519E02B883C86E91ACBE9340012A30DCFD2C1DA8796A4EB2FAC7", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000010757} 2024-07-09 00:49:42.211 {"level":"debug","ts":"2024-07-08T23:49:42.211Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:49:42.211 {"level":"debug","ts":"2024-07-08T23:49:42.211Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:49:46.979 2024-07-08T23:49:46.979Z INFO pidstore pidstore/pidstore.go:84 Persisted peers successfully {"amount": 88} 2024-07-09 00:49:46.979 2024-07-08T23:49:46.979Z INFO pidstore pidstore/pidstore.go:84 Persisted peers successfully {"amount": 88} 2024-07-09 00:49:47.075 Failed: map[1433627:4 1433636:4 1433730:3 1433752:3 1433763:3 1433776:3 1433779:3 1433783:3 1433788:3 1433790:3 1433792:3 1433799:2 1433805:2 1433807:2 1433808:2 1433814:2 1433823:2 1433827:2 1433838:1 1433846:1] 2024-07-09 00:49:47.075 2024-07-08T23:49:47.075Z INFO das das/store.go:59 stored checkpoint to disk: SampleFrom: 1433866, NetworkHead: 1433865 2024-07-09 00:49:47.075 Failed: map[1433627:4 1433636:4 1433730:3 1433752:3 1433763:3 1433776:3 1433779:3 1433783:3 1433788:3 1433790:3 1433792:3 1433799:2 1433805:2 1433807:2 1433808:2 1433814:2 1433823:2 1433827:2 1433838:1 1433846:1] 2024-07-09 00:49:47.075 2024-07-08T23:49:47.075Z INFO das das/store.go:59 stored checkpoint to disk: SampleFrom: 1433866, NetworkHead: 1433865 2024-07-09 00:49:47.289 2024-07-08T23:49:47.289Z WARN share/discovery discovery/discovery.go:219 Potentially degraded connectivity, unable to discover the desired amount of full peers in 5m0s. Number of peers discovered: 0. Required: 5. 2024-07-09 00:49:47.289 2024-07-08T23:49:47.289Z WARN share/discovery discovery/discovery.go:219 Potentially degraded connectivity, unable to discover the desired amount of full peers in 5m0s. Number of peers discovered: 0. Required: 5. 2024-07-09 00:49:51.137 2024-07-08T23:49:51.137Z INFO header/store store/store.go:375 new head {"height": 1433866, "hash": "F7B02BA12F83510AA4F74FC92A5F4C099E25DFACD12BEEA68A29CEEFFBAAA46B"} 2024-07-09 00:49:51.137 2024-07-08T23:49:51.137Z INFO header/store store/store.go:375 new head {"height": 1433866, "hash": "F7B02BA12F83510AA4F74FC92A5F4C099E25DFACD12BEEA68A29CEEFFBAAA46B"} 2024-07-09 00:49:51.138 2024-07-08T23:49:51.137Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433866, "hash": "F7B02BA12F83510AA4F74FC92A5F4C099E25DFACD12BEEA68A29CEEFFBAAA46B", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000010708} 2024-07-09 00:49:51.138 2024-07-08T23:49:51.137Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433866, "hash": "F7B02BA12F83510AA4F74FC92A5F4C099E25DFACD12BEEA68A29CEEFFBAAA46B", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000010708} 2024-07-09 00:50:01.293 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:50:01.294 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:50:01.294 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:50:01.294 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:50:01.294 pam_unix(cron:session): session opened for user ubuntu(uid=1000) by (uid=0) 2024-07-09 00:50:01.294 (ubuntu) CMD (/usr/local/sbin/celestia_balances.sh) 2024-07-09 00:50:01.294 (ubuntu) CMD (/usr/local/sbin/rollappd_version.sh) 2024-07-09 00:50:01.295 (ubuntu) CMD (/usr/local/sbin/celestia_version.sh) 2024-07-09 00:50:01.295 (ubuntu) CMD (/usr/local/sbin/sequencer_balances.sh) 2024-07-09 00:50:01.295 (ubuntu) CMD (/usr/local/sbin/dymd_version.sh) 2024-07-09 00:50:01.295 (CRON) info (No MTA installed, discarding output) 2024-07-09 00:50:01.295 (CRON) info (No MTA installed, discarding output) 2024-07-09 00:50:01.295 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:50:01.295 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:50:01.362 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:50:01.381 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:50:01.387 pam_unix(cron:session): session closed for user ubuntu 2024-07-09 00:50:02.530 2024-07-08T23:50:02.530Z INFO header/store store/store.go:375 new head {"height": 1433867, "hash": "E1C51B365D2F34952BC02AF7BCB0A64AB7AF5AB0FE87DC64CFA2CA2CB472AC44"} 2024-07-09 00:50:02.530 2024-07-08T23:50:02.530Z INFO header/store store/store.go:375 new head {"height": 1433867, "hash": "E1C51B365D2F34952BC02AF7BCB0A64AB7AF5AB0FE87DC64CFA2CA2CB472AC44"} 2024-07-09 00:50:09.528 badger 2024/07/08 23:50:09 INFO: Block cache metrics: hit: 43935098 miss: 27237185 keys-added: 1644770 keys-updated: 640108 keys-evicted: 1622341 cost-added: 17199488672 cost-evicted: 16931059340 sets-dropped: 0 sets-rejected: 4737949 gets-dropped: 177024 gets-kept: 70990720 gets-total: 71172283 hit-ratio: 0.62 2024-07-09 00:50:09.528 badger 2024/07/08 23:50:09 INFO: Block cache metrics: hit: 43935098 miss: 27237185 keys-added: 1644770 keys-updated: 640108 keys-evicted: 1622341 cost-added: 17199488672 cost-evicted: 16931059340 sets-dropped: 0 sets-rejected: 4737949 gets-dropped: 177024 gets-kept: 70990720 gets-total: 71172283 hit-ratio: 0.62 2024-07-09 00:50:12.212 {"level":"debug","ts":"2024-07-08T23:50:12.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:50:12.212 {"level":"debug","ts":"2024-07-08T23:50:12.212Z","msg":"refreshing demand orders","module":"order-fetcher"} 2024-07-09 00:50:13.733 2024-07-08T23:50:13.733Z INFO header/store store/store.go:375 new head {"height": 1433868, "hash": "A250E8229D84A83FD9EFEA42D1570F664E59F60E9D488E9B8D6203C01E17AEA7"} 2024-07-09 00:50:13.733 2024-07-08T23:50:13.733Z INFO header/store store/store.go:375 new head {"height": 1433868, "hash": "A250E8229D84A83FD9EFEA42D1570F664E59F60E9D488E9B8D6203C01E17AEA7"} 2024-07-09 00:50:13.733 2024-07-08T23:50:13.733Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433868, "hash": "A250E8229D84A83FD9EFEA42D1570F664E59F60E9D488E9B8D6203C01E17AEA7", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000008287} 2024-07-09 00:50:13.733 2024-07-08T23:50:13.733Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433868, "hash": "A250E8229D84A83FD9EFEA42D1570F664E59F60E9D488E9B8D6203C01E17AEA7", "square width": 2, "data root": "3D96B7D238E7E0456F6AF8E7CDF0A67BD6CF9C2089ECB559C659DCAA1F880353", "finished (s)": 0.000008287} 2024-07-09 00:50:17.000 time="2024-07-08T23:50:17Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 00:50:17.935 time="2024-07-08T23:50:17Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 00:50:17.935 context canceled 2024-07-09 00:50:17.935 2024-07-08T23:50:17.935Z WARN rpc go-jsonrpc@v0.3.1/handler.go:444 error in RPC call to 'blob.Included': failed to open stream: context canceled 2024-07-09 00:50:17.935 context canceled 2024-07-09 00:50:17.935 2024-07-08T23:50:17.935Z WARN rpc go-jsonrpc@v0.3.1/handler.go:444 error in RPC call to 'blob.Included': failed to open stream: context canceled 2024-07-09 00:50:20.938 2024-07-08T23:50:20.938Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:50:20.938 2024-07-08T23:50:20.938Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:50:21.714 2024-07-08T23:50:21.714Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:50:21.714 2024-07-08T23:50:21.714Z INFO blob blob/service.go:261 requesting blob {"height": 1433846, "namespace": "000000000000000000000000000000000000008f8736b6ff9dc08065a6"} 2024-07-09 00:50:25.149 2024-07-08T23:50:25.149Z INFO header/store store/store.go:375 new head {"height": 1433869, "hash": "644703AA13BEB868DAB189385F9CCD364AEDFA15A496D15A8F8CAA224CB2808C"} 2024-07-09 00:50:25.149 2024-07-08T23:50:25.149Z INFO header/store store/store.go:375 new head {"height": 1433869, "hash": "644703AA13BEB868DAB189385F9CCD364AEDFA15A496D15A8F8CAA224CB2808C"} 2024-07-09 00:50:27.010 2024-07-08T23:50:27.010Z ERROR share/light light/availability.go:146 availability validation failed {"root": "BF2FF90EF0E9145E6D79286CE077F242D23660D5365D8EDD97E30A991F703866", "failed_samples": [{"Row":39,"Col":59},{"Row":35,"Col":36},{"Row":37,"Col":27},{"Row":18,"Col":62},{"Row":18,"Col":21}]} 2024-07-09 00:50:27.010 2024-07-08T23:50:27.010Z ERROR share/light light/availability.go:146 availability validation failed {"root": "BF2FF90EF0E9145E6D79286CE077F242D23660D5365D8EDD97E30A991F703866", "failed_samples": [{"Row":39,"Col":59},{"Row":35,"Col":36},{"Row":37,"Col":27},{"Row":18,"Col":62},{"Row":18,"Col":21}]} 2024-07-09 00:50:27.010 2024-07-08T23:50:27.010Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433799, "to": 1433799, "errors": 1, "finished (s)": 160.00033423} 2024-07-09 00:50:27.010 2024-07-08T23:50:27.010Z INFO das das/worker.go:88 finished sampling headers {"type": "retry", "from": 1433799, "to": 1433799, "errors": 1, "finished (s)": 160.00033423} 2024-07-09 00:50:27.358 2024-07-08T23:50:27.357Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433869, "hash": "644703AA13BEB868DAB189385F9CCD364AEDFA15A496D15A8F8CAA224CB2808C", "square width": 8, "data root": "7FFA0AD5EE41A3036C991CAC70BAD408291A69D50ED2A0595309CBD691E81001", "finished (s)": 2.20867324} 2024-07-09 00:50:27.358 2024-07-08T23:50:27.357Z INFO das das/worker.go:148 sampled header {"type": "recent", "height": 1433869, "hash": "644703AA13BEB868DAB189385F9CCD364AEDFA15A496D15A8F8CAA224CB2808C", "square width": 8, "data root": "7FFA0AD5EE41A3036C991CAC70BAD408291A69D50ED2A0595309CBD691E81001", "finished (s)": 2.20867324} 2024-07-09 00:50:29.000 time="2024-07-08T23:50:29Z" level=error msg="failed to broadcast tx[error invalid nonce; got 17003, expected 17004: invalid sequence: invalid sequence]" module=backend 2024-07-09 00:50:29.000 time="2024-07-08T23:50:29Z" level=error msg="failed to broadcast tx[e

:13:59.000 time="2024-07-09T08:13:59Z" level=info msg="rejected bad transaction[priority 0 tx 85522115C03D5AB4F2ED85FD6EE9A817826E93B243ADE0E0182C5C64FA9006C2 peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 09:13:59.445 time="2024-07-09T08:13:59Z" level=info msg="rejected bad transaction[priority 0 tx 85522115C03D5AB4F2ED85FD6EE9A817826E93B243ADE0E0182C5C64FA9006C2 peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 09:13:59.446 time="2024-07-09T08:13:59Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.6:21768 reqid 358054 duration 1.523096ms err invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=geth 2024-07-09 09:13:59.446 time="2024-07-09T08:13:59Z" level=error msg="failed to broadcast tx[error invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=backend 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=error msg="failed to broadcast tx[error invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=backend 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=error msg="Serving prometheus server.[error http: Server closed]" 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=error msg="stop P2P client[error context canceled; context canceled; context canceled; context canceled]" 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=error msg="subscription cancelled[clientID RPCNodeHealthStatusHandler]" 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Stopping Celestia Data Availability Layer Client.[]" module=celestia 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 227154 duration 758.845µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 29484 duration 722.111µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 9139 duration 622.043µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:42808 reqid 317503 duration 725.205µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:60902 reqid 30617 duration 668.443µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 114890 duration 777.117µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 492333 duration 666.219µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 2015080 duration 666.112µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 49184 duration 666.005µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getBalance[conn 10.200.8.6:21768 reqid 18998 duration 590.38µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getBalance[conn 10.200.8.6:60902 reqid 808967 duration 629.436µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getBalance[conn 10.200.8.85:20352 reqid 115393 duration 689.8µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getLogs[conn 10.200.8.6:60902 reqid 2049164 duration 708.745µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getLogs[conn 10.200.8.85:20352 reqid 2049137 duration 1.982509ms err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getLogs[conn 10.200.8.85:20352 reqid 2049138 duration 639.889µs err method handler crashed]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.6:21768 reqid 358057 duration 1.525542ms err invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=geth 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="rejected bad transaction[priority 0 tx AFE6756B9515B240810037A97D35D2F3A30AFBD0AF5764769505BA663C835243 peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 09:14:00.000 time="2024-07-09T08:14:00Z" level=info msg="service stop[msg Stopping Node service impl Node]" 2024-07-09 09:14:00.298 time="2024-07-09T08:14:00Z" level=info msg="rejected bad transaction[priority 0 tx AFE6756B9515B240810037A97D35D2F3A30AFBD0AF5764769505BA663C835243 peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 09:14:00.299 time="2024-07-09T08:14:00Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.6:21768 reqid 358057 duration 1.525542ms err invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=geth 2024-07-09 09:14:00.299 time="2024-07-09T08:14:00Z" level=error msg="failed to broadcast tx[error invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=backend 2024-07-09 09:14:00.705 ubuntu : TTY=pts/1 ; PWD=/home/ubuntu ; USER=root ; COMMAND=/usr/bin/systemctl restart rollapp 2024-07-09 09:14:00.705 pam_unix(sudo:session): session opened for user root(uid=0) by ubuntu(uid=1000) 2024-07-09 09:14:00.710 time="2024-07-09T08:14:00Z" level=info msg="service stop[msg Stopping Node service impl Node]" 2024-07-09 09:14:00.710 Stopping rollapp... 2024-07-09 09:14:00.713 time="2024-07-09T08:14:00Z" level=error msg="Blob submitted not found in DA. Retrying availability check.[]" module=celestia 2024-07-09 09:14:00.713 time="2024-07-09T08:14:00Z" level=error msg="subscription cancelled[clientID RPCNodeHealthStatusHandler]" 2024-07-09 09:14:00.713 time="2024-07-09T08:14:00Z" level=error msg="Serving prometheus server.[error http: Server closed]" 2024-07-09 09:14:00.713 time="2024-07-09T08:14:00Z" level=info msg="Stopping Celestia Data Availability Layer Client.[]" module=celestia 2024-07-09 09:14:00.714 badger 2024/07/09 08:14:00 INFO: Lifetime L0 stalled for: 0s 2024-07-09 09:14:00.714 badger 2024/07/09 08:14:00 INFO: Lifetime L0 stalled for: 0s 2024-07-09 09:14:00.714 time="2024-07-09T08:14:00Z" level=error msg="stop P2P client[error context canceled; context canceled; context canceled; context canceled]" 2024-07-09 09:14:00.725 goroutine 111181406 [running]: 2024-07-09 09:14:00.725 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.725 net/http.HandlerFunc.ServeHTTP(0x4127fc5200?, {0x3f1ce20?, 0x400b268700?}, 0x0?) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.725 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400b268700?}, 0x4127fc5200?) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400b268700}, 0x4127fc5200, 0x0) 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.725 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d02d9898?, 0x41d02d97c8?, 0x959ce0?}) 2024-07-09 09:14:00.725 net/http.(conn).serve.func1() 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.725 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d02d9898, 0x2, 0x2?}) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400b268700}, 0x4127fc5200) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x411195ae80, 0xa, 0x10}) 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400b268700}, 0x4127fc5200) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.725 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x411195ae70?, 0x9?, 0x3736616264343161?}) 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4163a51ea8, 0x12, 0x12}) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(Txn).Get(0x400b266480, {0x411195ae80, 0xa, 0x10}) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.725 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.725 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400b268700?}, 0x400b268700?) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.725 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400b268700?}, 0x0?) 2024-07-09 09:14:00.725 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.725 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400b268700?}, 0x6?) 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.725 net/http.(ServeMux).ServeHTTP(0x41d02d9a08?, {0x3f1ce20, 0x400b268700}, 0x4127fc5200) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.725 2024/07/09 08:14:00 http: panic serving 10.200.8.6:47474: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.725 net/http.(conn).serve(0x4011ba7320, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.725 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400b268700?}, 0x0?) 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.725 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400b268700?}, 0x6?) 2024-07-09 09:14:00.725 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.725 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400b268700?}, 0x400b268700?) 2024-07-09 09:14:00.725 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.725 net/http.(conn).serve(0x4011ba7320, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.725 net/http.(ServeMux).ServeHTTP(0x41d02d9a08?, {0x3f1ce20, 0x400b268700}, 0x4127fc5200) 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(Txn).Get(0x400b266480, {0x411195ae80, 0xa, 0x10}) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400b268700?}, 0x4127fc5200?) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x411195ae80, 0xa, 0x10}) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.725 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d02d9898, 0x2, 0x2?}) 2024-07-09 09:14:00.725 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.725 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4163a51ea8, 0x12, 0x12}) 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.725 net/http.HandlerFunc.ServeHTTP(0x4127fc5200?, {0x3f1ce20?, 0x400b268700?}, 0x0?) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400b268700}, 0x4127fc5200, 0x0) 2024-07-09 09:14:00.725 2024/07/09 08:14:00 http: panic serving 10.200.8.6:47474: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.725 goroutine 111181406 [running]: 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400b268700}, 0x4127fc5200) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x411195ae70?, 0x9?, 0x3736616264343161?}) 2024-07-09 09:14:00.725 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400b268700}, 0x4127fc5200) 2024-07-09 09:14:00.725 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.725 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d02d9898?, 0x41d02d97c8?, 0x959ce0?}) 2024-07-09 09:14:00.725 net/http.(conn).serve.func1() 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.725 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.725 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.725 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.728 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getLogs[conn 10.200.8.85:20352 reqid 2049137 duration 1.982509ms err method handler crashed]" module=geth 2024-07-09 09:14:00.728 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_getLogs crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118084085 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4125d1e468, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d7a2280, {0x408940eaa0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x408940eaa0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x408940ea90?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x722f30?, 0x9457cdb57be03d0d?}, 0x326372653a6b2f73?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).HeaderByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:293 +0x2c\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(Filter).Logs(0x400d7a2000, {0x401e4405e0?, 0x3f57a18?}, 0x2710, 0x2710)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/filters.go:136 +0x328\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(PublicFilterAPI).GetLogs(0x401dae2f00, {0x3f3a8d0, 0x416ff500f0}, {0x0, 0x41531d80c0, 0x41531d80e0, {0x4125d1e030, 0x1, 0x1}, {0x41074ae630, ...}})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/api.go:550 +0x1d8\nreflect.Value.call({0x401e468600?, 0x40cf1e0f58?, 0x50?}, {0x2f3d5d6, 0x4}, {0x416ff50190, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401e468600?, 0x40cf1e0f58?, 0x16?}, {0x416ff50190?, 0x0?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401e468660, {0x3f3a8d0, 0x416ff500f0}, {0x408940e0e0, 0xb}, {0x4116c86078, 0x1, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d79e000?, {0x3f3a8d0?, 0x416ff500f0?}, 0x4174da0000, 0x1?, {0x4116c86078?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a8f68120, 0x41074ae510, 0x4174da0000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a8f68120, 0x41074ae510, 0x4174da0000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x41074ae510)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.748 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118084158 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4039a4a690, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x411cd0e380, {0x41b3d50a50, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41b3d50a50, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41b3d50a40?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4011664000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x4039a4a180, 0x4039a4a198, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x408922c1b0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x4039a4a180, 0x4039a4a198, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x408922c1b0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x411cd0e100, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x411cd0e100?, 0x10?, 0x4000ab4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400f86c820}, {0x41b3d501b0, 0x8}, {0x400f86c870, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d718000?, {0x3f3a8d0?, 0x400f86c820?}, 0x411bfa2070, 0x3?, {0x400f86c870?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a84841b0, 0x415f22a840, 0x411bfa2070)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a84841b0, 0x415f22a840, 0x411bfa2070)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x415f22a840)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 832350\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.748 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 29484 duration 722.111µs err method handler crashed]" module=geth 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.769 net/http.HandlerFunc.ServeHTTP(0x40f26aac60?, {0x3f1ce20?, 0x4004992fc0?}, 0x0?) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.769 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x4004992fc0?}, 0x0?) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4185949d50, 0xa, 0x10}) 2024-07-09 09:14:00.769 2024/07/09 08:14:00 http: panic serving 10.200.8.6:9304: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x4004992fc0}, 0x40f26aac60) 2024-07-09 09:14:00.769 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d04df898, 0x2, 0x2?}) 2024-07-09 09:14:00.769 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x4004992fc0?}, 0x40f26aac60?) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.769 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.769 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4185949d40?, 0x9?, 0x0?}) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(Txn).Get(0x40199d4700, {0x4185949d50, 0xa, 0x10}) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.769 net/http.(conn).serve(0x4030078510, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.769 net/http.(conn).serve.func1() 2024-07-09 09:14:00.769 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d04df898?, 0x41d04df7c8?, 0x959ce0?}) 2024-07-09 09:14:00.769 goroutine 51962169 [running]: 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.769 net/http.(ServeMux).ServeHTTP(0x41d04dfa08?, {0x3f1ce20, 0x4004992fc0}, 0x40f26aac60) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.769 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x4004992fc0?}, 0x4004992fc0?) 2024-07-09 09:14:00.769 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x4004992fc0?}, 0x6?) 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x4004992fc0}, 0x40f26aac60) 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x4004992fc0}, 0x40f26aac60, 0x0) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.769 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41645f0e10, 0x12, 0x12}) 2024-07-09 09:14:00.769 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x4004992fc0}, 0x40f26aac60) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.769 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x4004992fc0?}, 0x40f26aac60?) 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.769 2024/07/09 08:14:00 http: panic serving 10.200.8.6:9304: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4185949d50, 0xa, 0x10}) 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.769 net/http.(ServeMux).ServeHTTP(0x41d04dfa08?, {0x3f1ce20, 0x4004992fc0}, 0x40f26aac60) 2024-07-09 09:14:00.769 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d04df898, 0x2, 0x2?}) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.769 net/http.(conn).serve(0x4030078510, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.769 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.769 goroutine 51962169 [running]: 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.769 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(Txn).Get(0x40199d4700, {0x4185949d50, 0xa, 0x10}) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x4004992fc0}, 0x40f26aac60, 0x0) 2024-07-09 09:14:00.769 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x4004992fc0?}, 0x0?) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.769 net/http.(conn).serve.func1() 2024-07-09 09:14:00.769 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d04df898?, 0x41d04df7c8?, 0x959ce0?}) 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.769 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.769 net/http.HandlerFunc.ServeHTTP(0x40f26aac60?, {0x3f1ce20?, 0x4004992fc0?}, 0x0?) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.769 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41645f0e10, 0x12, 0x12}) 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4185949d40?, 0x9?, 0x0?}) 2024-07-09 09:14:00.769 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.769 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x4004992fc0?}, 0x6?) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.769 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.769 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x4004992fc0}, 0x40f26aac60) 2024-07-09 09:14:00.769 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.769 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x4004992fc0?}, 0x4004992fc0?) 2024-07-09 09:14:00.779 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087528 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4190d71710, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d67a700, {0x4030a434c0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4030a434c0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4030a434b0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x415bd54000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x4190d71278, 0x4190d71290, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x4033305200, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x4190d71278, 0x4190d71290, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x4033305200, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400d67a480, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400d67a480?, 0x10?, 0x40be674808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x40f2845e00}, {0x4030a42b80, 0x8}, {0x40f2845e50, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d4a0c30?, {0x3f3a8d0?, 0x40f2845e00?}, 0x41c8674150, 0x3?, {0x40f2845e50?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a9122120, 0x40cbff5a40, 0x41c8674150)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a9122120, 0x40cbff5a40, 0x41c8674150)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x40cbff5a40)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117197470\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.779 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:42808 reqid 317503 duration 725.205µs err method handler crashed]" module=geth 2024-07-09 09:14:00.791 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087397 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41535af878, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400db82200, {0x4175872b70, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4175872b70, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4175872b60?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x41c4fca000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x41535af230, 0x41535af248, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40c5c49938, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x41535af230, 0x41535af248, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40c5c49938, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400a5b1f00, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400a5b1f00?, 0x10?, 0x4000680808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x4196d38fa0}, {0x4175872190, 0x8}, {0x4196d38ff0, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x41af194680?, {0x3f3a8d0?, 0x4196d38fa0?}, 0x4126d6b260, 0x3?, {0x4196d38ff0?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a8f68510, 0x4138d859e0, 0x4126d6b260)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a8f68510, 0x4138d859e0, 0x4126d6b260)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4138d859e0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.791 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 114890 duration 777.117µs err method handler crashed]" module=geth 2024-07-09 09:14:00.797 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087580 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x411db1b2c0, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x411cd0f800, {0x41bf656090, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41bf656090, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41bf656080?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4011664000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x411db1ade0, 0x411db1adf8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40cd806c00, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x411db1ade0, 0x411db1adf8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40cd806c00, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x411cd0f580, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x411cd0f580?, 0x10?, 0x4000c81808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x4010206820}, {0x414db81788, 0x8}, {0x4010206870, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d7180d0?, {0x3f3a8d0?, 0x4010206820?}, 0x411eb1cd90, 0x3?, {0x4010206870?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41bb548120, 0x418ba75bc0, 0x411eb1cd90)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41bb548120, 0x418ba75bc0, 0x411eb1cd90)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x418ba75bc0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 832350\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.797 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 227154 duration 758.845µs err method handler crashed]" module=geth 2024-07-09 09:14:00.801 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_getBalance crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087516 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41dd158b70, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400b5aa580, {0x4191f67c90, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4191f67c90, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4191f67c80?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0xe24d87130108?, 0x10?}, 0x405f3f4808?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).GetBalance(0x401d851408, {0xa9, 0x69, 0x9, 0x47, 0x4b, 0xa6, 0x5d, 0x35, 0x7f, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/account_info.go:169 +0xb0\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).GetBalance(0x401de67da0, {0xa9, 0x69, 0x9, 0x47, 0x4b, 0xa6, 0x5d, 0x35, 0x7f, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:252 +0x168\nreflect.Value.call({0x401de4d320?, 0x40cf1e0b90?, 0x60?}, {0x2f3d5d6, 0x4}, {0x400b5c1740, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401de4d320?, 0x40cf1e0b90?, 0x16?}, {0x400b5c1740?, 0x10?, 0x405f3f4808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4d380, {0x3f3a8d0, 0x400fe781e0}, {0x4191f67310, 0xe}, {0x417dc7f0e0, 0x2, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x40f0a2f540?, {0x3f3a8d0?, 0x400fe781e0?}, 0x416fefb3b0, 0x2?, {0x417dc7f0e0?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c29503f0, 0x417dc7f020, 0x416fefb3b0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c29503f0, 0x417dc7f020, 0x416fefb3b0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x417dc7f020)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 832350\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.802 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getBalance[conn 10.200.8.6:21768 reqid 18998 duration 590.38µs err method handler crashed]" module=geth 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4042c6e780?, 0x9?, 0x65646e657073070a?}) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0) 2024-07-09 09:14:00.809 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0, 0x0) 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.809 goroutine 15167262 [running]: 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d514800, {0x4042c6e790, 0xa, 0x10}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.809 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.809 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400d53a1c0?}, 0x0?) 2024-07-09 09:14:00.809 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.809 net/http.(conn).serve.func1() 2024-07-09 09:14:00.809 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41b60db5f0, 0x12, 0x12}) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4042c6e790, 0xa, 0x10}) 2024-07-09 09:14:00.809 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d04db898?, 0x41d04db7c8?, 0x959ce0?}) 2024-07-09 09:14:00.809 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.809 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400d53a1c0?}, 0x6?) 2024-07-09 09:14:00.809 net/http.(ServeMux).ServeHTTP(0x41d04dba08?, {0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0) 2024-07-09 09:14:00.809 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400d53a1c0?}, 0x400d53a1c0?) 2024-07-09 09:14:00.809 net/http.(conn).serve(0x408ddac000, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400d53a1c0?}, 0x41fb34d8c0?) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.809 2024/07/09 08:14:00 http: panic serving 10.200.8.85:61908: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.809 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d04db898, 0x2, 0x2?}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.809 net/http.HandlerFunc.ServeHTTP(0x41fb34d8c0?, {0x3f1ce20?, 0x400d53a1c0?}, 0x0?) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.809 net/http.(conn).serve.func1() 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0) 2024-07-09 09:14:00.809 2024/07/09 08:14:00 http: panic serving 10.200.8.85:61908: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0, 0x0) 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.809 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d514800, {0x4042c6e790, 0xa, 0x10}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.809 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.809 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400d53a1c0?}, 0x0?) 2024-07-09 09:14:00.809 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.809 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400d53a1c0?}, 0x6?) 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.809 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4042c6e790, 0xa, 0x10}) 2024-07-09 09:14:00.809 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d04db898?, 0x41d04db7c8?, 0x959ce0?}) 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4042c6e780?, 0x9?, 0x65646e657073070a?}) 2024-07-09 09:14:00.809 net/http.(ServeMux).ServeHTTP(0x41d04dba08?, {0x3f1ce20, 0x400d53a1c0}, 0x41fb34d8c0) 2024-07-09 09:14:00.809 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400d53a1c0?}, 0x400d53a1c0?) 2024-07-09 09:14:00.809 net/http.(conn).serve(0x408ddac000, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400d53a1c0?}, 0x41fb34d8c0?) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.809 goroutine 15167262 [running]: 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.809 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d04db898, 0x2, 0x2?}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.809 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41b60db5f0, 0x12, 0x12}) 2024-07-09 09:14:00.809 net/http.HandlerFunc.ServeHTTP(0x41fb34d8c0?, {0x3f1ce20?, 0x400d53a1c0?}, 0x0?) 2024-07-09 09:14:00.809 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.809 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.809 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.809 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.812 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.812 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400d53a2a0?}, 0x6?) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.812 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d02d5898?, 0x41d02d57c8?, 0x959ce0?}) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0, 0x0) 2024-07-09 09:14:00.812 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400d53a2a0?}, 0x0?) 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0) 2024-07-09 09:14:00.812 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400d53a2a0?}, 0x400d53a2a0?) 2024-07-09 09:14:00.812 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d02d5898, 0x2, 0x2?}) 2024-07-09 09:14:00.812 net/http.(conn).serve.func1() 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.812 net/http.HandlerFunc.ServeHTTP(0x41fb34d9e0?, {0x3f1ce20?, 0x400d53a2a0?}, 0x0?) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400d53a2a0?}, 0x41fb34d9e0?) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.812 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0) 2024-07-09 09:14:00.812 2024/07/09 08:14:00 http: panic serving 10.200.8.85:15742: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.812 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.812 goroutine 935409 [running]: 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4042c6e8f0, 0xa, 0x10}) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.812 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d514880, {0x4042c6e8f0, 0xa, 0x10}) 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41b60db638, 0x12, 0x12}) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.812 net/http.(ServeMux).ServeHTTP(0x41d02d5a08?, {0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.812 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.812 net/http.(conn).serve(0x40f0b32f30, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4042c6e8e0?, 0x9?, 0x0?}) 2024-07-09 09:14:00.812 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.812 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.812 net/http.(conn).serve(0x40f0b32f30, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41b60db638, 0x12, 0x12}) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.812 net/http.(ServeMux).ServeHTTP(0x41d02d5a08?, {0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4042c6e8e0?, 0x9?, 0x0?}) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.812 net/http.HandlerFunc.ServeHTTP(0x41fb34d9e0?, {0x3f1ce20?, 0x400d53a2a0?}, 0x0?) 2024-07-09 09:14:00.812 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41d02d5898?, 0x41d02d57c8?, 0x959ce0?}) 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0, 0x0) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.812 net/http.(conn).serve.func1() 2024-07-09 09:14:00.812 2024/07/09 08:14:00 http: panic serving 10.200.8.85:15742: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.812 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.812 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400d53a2a0?}, 0x0?) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400d53a2a0?}, 0x41fb34d9e0?) 2024-07-09 09:14:00.812 goroutine 935409 [running]: 2024-07-09 09:14:00.812 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400d53a2a0?}, 0x6?) 2024-07-09 09:14:00.812 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.812 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41d02d5898, 0x2, 0x2?}) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4042c6e8f0, 0xa, 0x10}) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.812 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.812 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400d53a2a0}, 0x41fb34d9e0) 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.812 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.812 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.812 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d514880, {0x4042c6e8f0, 0xa, 0x10}) 2024-07-09 09:14:00.812 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400d53a2a0?}, 0x400d53a2a0?) 2024-07-09 09:14:00.825 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_getBalance crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087589 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41411183a8, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d515000, {0x412acf6670, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x412acf6670, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x412acf6660?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0xe24d87132b38?, 0x10?}, 0x405f3f4008?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).GetBalance(0x401d851408, {0xaf, 0x91, 0xe, 0x99, 0xc1, 0xd7, 0xa1, 0x4d, 0xba, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/account_info.go:169 +0xb0\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).GetBalance(0x401de67da0, {0xaf, 0x91, 0xe, 0x99, 0xc1, 0xd7, 0xa1, 0x4d, 0xba, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:252 +0x168\nreflect.Value.call({0x401de4d320?, 0x40cf1e0b90?, 0x60?}, {0x2f3d5d6, 0x4}, {0x400d6aede0, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401de4d320?, 0x40cf1e0b90?, 0x16?}, {0x400d6aede0?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4d380, {0x3f3a8d0, 0x4154348fa0}, {0x4042c6fd10, 0xe}, {0x41c3e79800, 0x2, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x40f71159c0?, {0x3f3a8d0?, 0x4154348fa0?}, 0x4193b06770, 0x2?, {0x41c3e79800?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a8402b40, 0x41c3e79740, 0x4193b06770)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a8402b40, 0x41c3e79740, 0x4193b06770)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x41c3e79740)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.825 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getBalance[conn 10.200.8.85:20352 reqid 115393 duration 689.8µs err method handler crashed]" module=geth 2024-07-09 09:14:00.845 Level 4 [ ]: NumTables: 00. Size: 0 B of 578 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 8.0 MiB 2024-07-09 09:14:00.845 Level 0 [ ]: NumTables: 03. Size: 47 MiB of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 64 MiB 2024-07-09 09:14:00.845 Level Done 2024-07-09 09:14:00.845 Level 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB 2024-07-09 09:14:00.845 Level 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB 2024-07-09 09:14:00.845 badger 2024/07/09 08:14:00 INFO: 2024-07-09 09:14:00.845 Level 3 [ ]: NumTables: 00. Size: 0 B of 58 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 4.0 MiB 2024-07-09 09:14:00.845 Level 5 [B]: NumTables: 401. Size: 5.6 GiB of 5.6 GiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 16 MiB 2024-07-09 09:14:00.845 Level 6 [ ]: NumTables: 2387. Size: 56 GiB of 56 GiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 32 MiB 2024-07-09 09:14:00.845 Level 0 [ ]: NumTables: 03. Size: 47 MiB of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 64 MiB 2024-07-09 09:14:00.845 Level 6 [ ]: NumTables: 2387. Size: 56 GiB of 56 GiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 32 MiB 2024-07-09 09:14:00.845 Level 5 [B]: NumTables: 401. Size: 5.6 GiB of 5.6 GiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 16 MiB 2024-07-09 09:14:00.845 Level 4 [ ]: NumTables: 00. Size: 0 B of 578 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 8.0 MiB 2024-07-09 09:14:00.845 Level 3 [ ]: NumTables: 00. Size: 0 B of 58 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 4.0 MiB 2024-07-09 09:14:00.845 Level 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB 2024-07-09 09:14:00.845 Level 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB 2024-07-09 09:14:00.845 badger 2024/07/09 08:14:00 INFO: 2024-07-09 09:14:00.845 Level Done 2024-07-09 09:14:00.850 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087582 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x411db1b7a0, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x411cd0fc00, {0x41bf656c20, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41bf656c20, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41bf656c10?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4011664000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x411db1b398, 0x411db1b3b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40cd807518, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x411db1b398, 0x411db1b3b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40cd807518, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x411cd0f980, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x411cd0f980?, 0x10?, 0x4000c81808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x4010206d20}, {0x41bf656258, 0x8}, {0x4010206d70, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d7181a0?, {0x3f3a8d0?, 0x4010206d20?}, 0x411eb1dc00, 0x3?, {0x4010206d70?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a8485cb0, 0x412d419830, 0x411eb1dc00)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a8485cb0, 0x412d419830, 0x411eb1dc00)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x412d419830)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 107619043\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.850 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 2015080 duration 666.112µs err method handler crashed]" module=geth 2024-07-09 09:14:00.853 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087584 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x411db1bc98, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d80a080, {0x41bf657670, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41bf657670, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41bf657660?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4011664000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x411db1b860, 0x411db1b878, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40cd807dd0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x411db1b860, 0x411db1b878, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40cd807dd0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x411cd0fd80, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x411cd0fd80?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x4010207130}, {0x41bf656d70, 0x8}, {0x4010207180, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d718270?, {0x3f3a8d0?, 0x4010207130?}, 0x40e8c26e00, 0x3?, {0x4010207180?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c2e48120, 0x41311e72c0, 0x40e8c26e00)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c2e48120, 0x41311e72c0, 0x40e8c26e00)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x41311e72c0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 111412279\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.853 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:60902 reqid 30617 duration 668.443µs err method handler crashed]" module=geth 2024-07-09 09:14:00.892 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087597 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4141119d10, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d515a00, {0x41804c2fa0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41804c2fa0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41804c2f90?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x405bf98000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x4141119458, 0x4141119488, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40d4c3a9a8, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x4141119458, 0x4141119488, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40d4c3a9a8, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400d515780, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400d515780?, 0x10?, 0x4000c81808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400fa947d0}, {0x41804c26a0, 0x8}, {0x400fa94910, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x40197c32b0?, {0x3f3a8d0?, 0x400fa947d0?}, 0x41493d99d0, 0x3?, {0x400fa94910?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a84038c0, 0x4150cdad20, 0x41493d99d0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a84038c0, 0x4150cdad20, 0x41493d99d0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4150cdad20)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 832350\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.892 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 9139 duration 622.043µs err method handler crashed]" module=geth 2024-07-09 09:14:00.908 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087622 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x40a888b260, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d80aa80, {0x4198f2bcc0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4198f2bcc0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4198f2bcb0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4011664000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x40a888ab10, 0x40a888ab40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x412fc53f38, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x40a888ab10, 0x40a888ab40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x412fc53f38, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400d80a800, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400d80a800?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x4010207c70}, {0x4198f2b330, 0x8}, {0x4010207d60, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d718340?, {0x3f3a8d0?, 0x4010207c70?}, 0x415884c150, 0x3?, {0x4010207d60?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c2e48ab0, 0x417d47bc20, 0x415884c150)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c2e48ab0, 0x417d47bc20, 0x415884c150)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x417d47bc20)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 107619043\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.908 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 49184 duration 666.005µs err method handler crashed]" module=geth 2024-07-09 09:14:00.916 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_getLogs crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118084220 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41645f1e90, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x40199d4e00, {0x413cd50330, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x413cd50330, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x413cd50320?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x1?, 0x1?}, 0x0?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).HeaderByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:293 +0x2c\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(Filter).Logs(0x40199d4b80, {0x401e4405e0?, 0x3f57a18?}, 0x2710, 0x2710)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/filters.go:136 +0x328\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(PublicFilterAPI).GetLogs(0x401dae2f00, {0x3f3a8d0, 0x400fa09310}, {0x0, 0x4145611be0, 0x4145611c00, {0x41645f1998, 0x1, 0x1}, {0x40e8a31e90, ...}})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/api.go:550 +0x1d8\nreflect.Value.call({0x401e468600?, 0x40cf1e0f58?, 0x50?}, {0x2f3d5d6, 0x4}, {0x400fa093b0, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401e468600?, 0x40cf1e0f58?, 0x16?}, {0x400fa093b0?, 0x0?, 0x4000c81808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401e468660, {0x3f3a8d0, 0x400fa09310}, {0x415db579d0, 0xb}, {0x404ca42a68, 0x1, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400db7a000?, {0x3f3a8d0?, 0x400fa09310?}, 0x41b6d91c70, 0x1?, {0x404ca42a68?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a8500bd0, 0x40e8a31da0, 0x41b6d91c70)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a8500bd0, 0x40e8a31da0, 0x41b6d91c70)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x40e8a31da0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 111412279\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.916 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getLogs[conn 10.200.8.6:60902 reqid 2049164 duration 708.745µs err method handler crashed]" module=geth 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x40f7dc91c0?, 0x9?, 0x0?}) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x40045c55e0}, 0x404312f200) 2024-07-09 09:14:00.916 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x40045c55e0}, 0x404312f200, 0x0) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(Txn).Get(0x402f4aa680, {0x40f7dc91d0, 0xa, 0x10}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.916 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.916 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x40045c55e0?}, 0x0?) 2024-07-09 09:14:00.916 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.916 net/http.(conn).serve.func1() 2024-07-09 09:14:00.916 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x40045c55e0}, 0x404312f200) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4171d7ab40, 0x12, 0x12}) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x40f7dc91d0, 0xa, 0x10}) 2024-07-09 09:14:00.916 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x4008057898?, 0x403c3ab7c8?, 0x959ce0?}) 2024-07-09 09:14:00.916 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.916 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x40045c55e0?}, 0x6?) 2024-07-09 09:14:00.916 net/http.(ServeMux).ServeHTTP(0x403c3aba08?, {0x3f1ce20, 0x40045c55e0}, 0x404312f200) 2024-07-09 09:14:00.916 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x40045c55e0?}, 0x40045c55e0?) 2024-07-09 09:14:00.916 net/http.(conn).serve(0x41c2e48d80, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x40045c55e0?}, 0x404312f200?) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.916 goroutine 118087623 [running]: 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.916 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x4008057898, 0x2, 0x2?}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.916 2024/07/09 08:14:00 http: panic serving 10.200.8.85:8646: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.916 net/http.HandlerFunc.ServeHTTP(0x404312f200?, {0x3f1ce20?, 0x40045c55e0?}, 0x0?) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:00.916 goroutine 118087623 [running]: 2024-07-09 09:14:00.916 net/http.HandlerFunc.ServeHTTP(0x404312f200?, {0x3f1ce20?, 0x40045c55e0?}, 0x0?) 2024-07-09 09:14:00.916 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x40f7dc91d0, 0xa, 0x10}) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x40045c55e0}, 0x404312f200, 0x0) 2024-07-09 09:14:00.916 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x40045c55e0?}, 0x6?) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:00.916 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:00.916 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x40045c55e0?}, 0x404312f200?) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x40045c55e0}, 0x404312f200) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x40045c55e0}, 0x404312f200) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:00.916 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x40045c55e0?}, 0x0?) 2024-07-09 09:14:00.916 net/http.(conn).serve(0x41c2e48d80, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:00.916 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:00.916 net/http.(ServeMux).ServeHTTP(0x403c3aba08?, {0x3f1ce20, 0x40045c55e0}, 0x404312f200) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:00.916 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x40f7dc91c0?, 0x9?, 0x0?}) 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(Txn).Get(0x402f4aa680, {0x40f7dc91d0, 0xa, 0x10}) 2024-07-09 09:14:00.916 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:00.916 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4171d7ab40, 0x12, 0x12}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:00.916 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x4008057898?, 0x403c3ab7c8?, 0x959ce0?}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:00.916 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x4008057898, 0x2, 0x2?}) 2024-07-09 09:14:00.916 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:00.916 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:00.916 net/http.(conn).serve.func1() 2024-07-09 09:14:00.916 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x40045c55e0?}, 0x40045c55e0?) 2024-07-09 09:14:00.916 2024/07/09 08:14:00 http: panic serving 10.200.8.85:8646: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:00.929 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087610 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x412aa4eeb8, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400b5ab580, {0x40be184350, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x40be184350, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x40be184340?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4005782000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x412aa4ea80, 0x412aa4ea98, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40eaca9818, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x412aa4ea80, 0x412aa4ea98, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40eaca9818, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400b5ab300, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400b5ab300?, 0x10?, 0x405f3f4808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400fe79b30}, {0x416431fa10, 0x8}, {0x400fe79bd0, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x41cdb7bba0?, {0x3f3a8d0?, 0x400fe79b30?}, 0x4193a08850, 0x3?, {0x400fe79bd0?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c29518c0, 0x41cc80fd70, 0x4193a08850)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c29518c0, 0x41cc80fd70, 0x4193a08850)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x41cc80fd70)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.929 time="2024-07-09T08:14:00Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 492333 duration 666.219µs err method handler crashed]" module=geth 2024-07-09 09:14:00.979 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getLogs[conn 10.200.8.85:20352 reqid 2049138 duration 639.889µs err method handler crashed]" module=geth 2024-07-09 09:14:00.979 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_getLogs crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087642 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x41927072c0, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x402f4ab780, {0x4153721ef0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4153721ef0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4153721ed0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x1?, 0x1?}, 0x0?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).HeaderByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:293 +0x2c\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(Filter).Logs(0x402f4ab500, {0x401e4405e0?, 0x3f57a18?}, 0x2710, 0x2710)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/filters.go:136 +0x328\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(PublicFilterAPI).GetLogs(0x401dae2f00, {0x3f3a8d0, 0x4010056c80}, {0x0, 0x410a412aa0, 0x410a412ac0, {0x4192706d68, 0x1, 0x1}, {0x416a03a0f0, ...}})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/api.go:550 +0x1d8\nreflect.Value.call({0x401e468600?, 0x40cf1e0f58?, 0x50?}, {0x2f3d5d6, 0x4}, {0x4010056e60, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401e468600?, 0x40cf1e0f58?, 0x16?}, {0x4010056e60?, 0x0?, 0x4000c81808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401e468660, {0x3f3a8d0, 0x4010056c80}, {0x4153721530, 0xb}, {0x40f8fdc3f0, 0x1, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x41d89118c0?, {0x3f3a8d0?, 0x4010056c80?}, 0x413d5480e0, 0x1?, {0x40f8fdc3f0?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x40458efcb0, 0x416a03a000, 0x413d5480e0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x40458efcb0, 0x416a03a000, 0x413d5480e0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x416a03a000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:00.993 time="2024-07-09T08:14:00Z" level=info msg="Served eth_getBalance[conn 10.200.8.6:60902 reqid 808967 duration 629.436µs err method handler crashed]" module=geth 2024-07-09 09:14:00.993 time="2024-07-09T08:14:00Z" level=error msg="RPC method eth_getBalance crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087666 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x42b9f0c960, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400dc1a400, {0x41693def60, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41693def60, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41693def50?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0xe24d871313c8?, 0x10?}, 0x4000c81808?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).GetBalance(0x401d851408, {0xf7, 0x94, 0xe6, 0x9e, 0x93, 0xcd, 0x77, 0xea, 0x0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/account_info.go:169 +0xb0\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).GetBalance(0x401de67da0, {0xf7, 0x94, 0xe6, 0x9e, 0x93, 0xcd, 0x77, 0xea, 0x0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:252 +0x168\nreflect.Value.call({0x401de4d320?, 0x40cf1e0b90?, 0x60?}, {0x2f3d5d6, 0x4}, {0x400dc20360, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401de4d320?, 0x40cf1e0b90?, 0x16?}, {0x400dc20360?, 0x10?, 0x4000c81808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4d380, {0x3f3a8d0, 0x4010057b30}, {0x41693de630, 0xe}, {0x4189e1a5d0, 0x2, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x41a736da00?, {0x3f3a8d0?, 0x4010057b30?}, 0x41b5123d50, 0x2?, {0x4189e1a5d0?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c32385a0, 0x4189e1a570, 0x41b5123d50)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c32385a0, 0x4189e1a570, 0x41b5123d50)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4189e1a570)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 111412279\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=error msg="failed to broadcast tx[error invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=backend 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="RPC HTTP server stopped[err accept tcp [::]:1317: use of closed network connection]" module=api-server 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 38472 duration 677.599µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.6:60902 reqid 37815 duration 709.204µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 1081545 duration 662.601µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 61296 duration 684.885µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 69078 duration 639.314µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 104176 duration 671.799µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 14827 duration 2.144245ms err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:35380 reqid 11004 duration 849.124µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:35380 reqid 26760 duration 582.963µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_getBalance[conn 10.200.8.85:20352 reqid 19555 duration 576.965µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_getLogs[conn 10.200.8.6:60902 reqid 2049139 duration 963.591µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_getLogs[conn 10.200.8.85:20352 reqid 2049165 duration 665.489µs err method handler crashed]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.6:21768 reqid 358060 duration 1.676029ms err invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=geth 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="EVM Block Explorer Json-RPC HTTP server shut down, waiting 5 sec[]" 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="HTTP server shut down, waiting 5 sec[]" 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="exiting...[]" 2024-07-09 09:14:01.000 time="2024-07-09T08:14:01Z" level=info msg="rejected bad transaction[priority 0 tx 369423B3C11BE57747895B20AE592A04C0A0E5BD78F40D79CBC1509B95E18680 peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 09:14:01.015 time="2024-07-09T08:14:01Z" level=info msg="rejected bad transaction[priority 0 tx 369423B3C11BE57747895B20AE592A04C0A0E5BD78F40D79CBC1509B95E18680 peer_id map[0:true] code 3 post_check_err ]" 2024-07-09 09:14:01.015 time="2024-07-09T08:14:01Z" level=info msg="Served eth_sendRawTransaction[conn 10.200.8.6:21768 reqid 358060 duration 1.676029ms err invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=geth 2024-07-09 09:14:01.015 time="2024-07-09T08:14:01Z" level=error msg="failed to broadcast tx[error invalid nonce; got 234920, expected 234921: invalid sequence: invalid sequence]" module=backend 2024-07-09 09:14:01.016 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118084222 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x42b9f0d470, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400dc1a980, {0x4025434380, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4025434380, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4025434370?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x401bbee000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x41645f1f98, 0x41645f1fe0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x404ca43398, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x41645f1f98, 0x41645f1fe0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x404ca43398, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x40199d4f80, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x40199d4f80?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400fa099f0}, {0x413cd504a0, 0x8}, {0x400fa09a40, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d756000?, {0x3f3a8d0?, 0x400fa099f0?}, 0x41d2b48a80, 0x3?, {0x400fa09a40?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41a85013b0, 0x414c2da150, 0x41d2b48a80)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41a85013b0, 0x414c2da150, 0x41d2b48a80)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x414c2da150)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 107619043\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.016 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:27076 reqid 14827 duration 2.144245ms err method handler crashed]" module=geth 2024-07-09 09:14:01.031 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087625 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x40a888b9b0, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d80af00, {0x41c393e6a0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41c393e6a0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41c393e690?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x4011664000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x40a888b428, 0x40a888b440, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x407ff62870, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x40a888b428, 0x40a888b440, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x407ff62870, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400d80ac80, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400d80ac80?, 0x10?, 0x4000500008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x40105a83c0}, {0x4198f2bdf8, 0x8}, {0x40105a84b0, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x400d718410?, {0x3f3a8d0?, 0x40105a83c0?}, 0x415884ce70, 0x3?, {0x40105a84b0?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c2e48f30, 0x4111af2ed0, 0x415884ce70)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c2e48f30, 0x4111af2ed0, 0x415884ce70)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4111af2ed0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 832350\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.031 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.6:21768 reqid 38472 duration 677.599µs err method handler crashed]" module=geth 2024-07-09 09:14:01.058 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087674 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x42b9f0de30, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400dc1af80, {0x40254357f0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x40254357f0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x40254357e0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x40033d4000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x42b9f0d9e0, 0x42b9f0d9f8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40251e9080, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x42b9f0d9e0, 0x42b9f0d9f8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40251e9080, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400dc1ad00, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400dc1ad00?, 0x10?, 0x4000500008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400fb9b220}, {0x4025434f20, 0x8}, {0x400fb9b270, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x419a94fa00?, {0x3f3a8d0?, 0x400fb9b220?}, 0x4153435180, 0x3?, {0x400fb9b270?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41cb7793b0, 0x401bfbef90, 0x4153435180)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41cb7793b0, 0x401bfbef90, 0x4153435180)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x401bfbef90)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.058 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 61296 duration 684.885µs err method handler crashed]" module=geth 2024-07-09 09:14:01.080 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087676 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4545740318, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400dc1b380, {0x411d8cc200, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x411d8cc200, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x411d8cc1f0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x40033d4000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x42b9f0df08, 0x42b9f0df20, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40251e9938, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x42b9f0df08, 0x42b9f0df20, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x40251e9938, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400dc1b100, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400dc1b100?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400fb9be00}, {0x4025435918, 0x8}, {0x400fb9be50, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x419a94fad0?, {0x3f3a8d0?, 0x400fb9be00?}, 0x4153435f10, 0x3?, {0x400fb9be50?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41cb7797a0, 0x41b5abb860, 0x4153435f10)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41cb7797a0, 0x41b5abb860, 0x4153435f10)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x41b5abb860)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 111412279\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.081 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.6:60902 reqid 37815 duration 709.204µs err method handler crashed]" module=geth 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41ce3006b0?, 0x9?, 0x0?}) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400dc84b60}, 0x41f570c360) 2024-07-09 09:14:01.092 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400dc84b60}, 0x41f570c360, 0x0) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d8c7000, {0x41ce3006c0, 0xa, 0x10}) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:01.092 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:01.092 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:01.092 2024/07/09 08:14:01 http: panic serving 10.200.8.85:8660: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:01.092 net/http.(conn).serve.func1() 2024-07-09 09:14:01.092 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400dc84b60}, 0x41f570c360) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x416ae46558, 0x12, 0x12}) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41ce3006c0, 0xa, 0x10}) 2024-07-09 09:14:01.092 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x400dc99898?, 0x400dc997c8?, 0x959ce0?}) 2024-07-09 09:14:01.092 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:01.092 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400dc84b60?}, 0x6?) 2024-07-09 09:14:01.092 net/http.(ServeMux).ServeHTTP(0x400dc99a08?, {0x3f1ce20, 0x400dc84b60}, 0x41f570c360) 2024-07-09 09:14:01.092 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400dc84b60?}, 0x400dc84b60?) 2024-07-09 09:14:01.092 net/http.(conn).serve(0x41c3238a20, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400dc84b60?}, 0x41f570c360?) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:01.092 goroutine 118087654 [running]: 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:01.092 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x400dc99898, 0x2, 0x2?}) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:01.092 net/http.HandlerFunc.ServeHTTP(0x41f570c360?, {0x3f1ce20?, 0x400dc84b60?}, 0x0?) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:01.092 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400dc84b60?}, 0x0?) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:01.092 net/http.(ServeMux).ServeHTTP(0x400dc99a08?, {0x3f1ce20, 0x400dc84b60}, 0x41f570c360) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:01.092 2024/07/09 08:14:01 http: panic serving 10.200.8.85:8660: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400dc84b60}, 0x41f570c360) 2024-07-09 09:14:01.092 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400dc84b60?}, 0x400dc84b60?) 2024-07-09 09:14:01.092 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:01.092 net/http.(conn).serve.func1() 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:01.092 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41ce3006c0, 0xa, 0x10}) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:01.092 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x416ae46558, 0x12, 0x12}) 2024-07-09 09:14:01.092 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400dc84b60?}, 0x0?) 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d8c7000, {0x41ce3006c0, 0xa, 0x10}) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41ce3006b0?, 0x9?, 0x0?}) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:01.092 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:01.092 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:01.092 net/http.(conn).serve(0x41c3238a20, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:01.092 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400dc84b60?}, 0x6?) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400dc84b60}, 0x41f570c360, 0x0) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:01.092 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x400dc99898, 0x2, 0x2?}) 2024-07-09 09:14:01.092 net/http.HandlerFunc.ServeHTTP(0x41f570c360?, {0x3f1ce20?, 0x400dc84b60?}, 0x0?) 2024-07-09 09:14:01.092 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:01.092 goroutine 118087654 [running]: 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:01.092 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400dc84b60}, 0x41f570c360) 2024-07-09 09:14:01.092 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400dc84b60?}, 0x41f570c360?) 2024-07-09 09:14:01.092 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x400dc99898?, 0x400dc997c8?, 0x959ce0?}) 2024-07-09 09:14:01.092 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:01.166 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087716 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x410f994060, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400d8c7b00, {0x4138455750, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4138455750, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4138455740?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x405bf98000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x416ae47a28, 0x416ae47a58, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x41ad753ab8, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x416ae47a28, 0x416ae47a58, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x41ad753ab8, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400d8c7880, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400d8c7880?, 0x10?, 0x405f3f4808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x417f11b4a0}, {0x4138454dc0, 0x8}, {0x417f11b540, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x40197c3450?, {0x3f3a8d0?, 0x417f11b4a0?}, 0x417fae3650, 0x3?, {0x417f11b540?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c75e62d0, 0x4138711980, 0x417fae3650)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c75e62d0, 0x4138711980, 0x417fae3650)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4138711980)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 114820193\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.166 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:35380 reqid 11004 duration 849.124µs err method handler crashed]" module=geth 2024-07-09 09:14:01.189 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_getBalance crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087722 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x410f995050, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400e454300, {0x411fcf1620, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x411fcf1620, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x411fcf1610?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0xe24d87132b38?, 0x10?}, 0x405f3f4008?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).GetBalance(0x401d851408, {0x3b, 0x58, 0xf6, 0x6c, 0xac, 0xfe, 0xda, 0xc4, 0x95, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/account_info.go:169 +0xb0\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).GetBalance(0x401de67da0, {0x3b, 0x58, 0xf6, 0x6c, 0xac, 0xfe, 0xda, 0xc4, 0x95, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:252 +0x168\nreflect.Value.call({0x401de4d320?, 0x40cf1e0b90?, 0x60?}, {0x2f3d5d6, 0x4}, {0x400e445740, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401de4d320?, 0x40cf1e0b90?, 0x16?}, {0x400e445740?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4d380, {0x3f3a8d0, 0x400f101310}, {0x411fcf0d00, 0xe}, {0x4138969110, 0x2, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x40f4a26880?, {0x3f3a8d0?, 0x400f101310?}, 0x418d62bb20, 0x2?, {0x4138969110?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c75e6990, 0x4138969020, 0x418d62bb20)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c75e6990, 0x4138969020, 0x418d62bb20)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4138969020)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.189 time="2024-07-09T08:14:01Z" level=info msg="Served eth_getBalance[conn 10.200.8.85:20352 reqid 19555 duration 576.965µs err method handler crashed]" module=geth 2024-07-09 09:14:01.194 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087726 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x410f995f68, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400e454b00, {0x411c9dd2e0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x411c9dd2e0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x411c9dd2d0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x405bf98000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x410f995aa0, 0x410f995ab8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x403ccbedb0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x410f995aa0, 0x410f995ab8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x403ccbedb0, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400e454880, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400e454880?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x400f1018b0}, {0x411c9dc9f0, 0x8}, {0x400f101950, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x40197c3520?, {0x3f3a8d0?, 0x400f1018b0?}, 0x41c1bc4000, 0x3?, {0x400f101950?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c75e7320, 0x40e9fcea80, 0x41c1bc4000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c75e7320, 0x40e9fcea80, 0x41c1bc4000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x40e9fcea80)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.195 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:20352 reqid 1081545 duration 662.601µs err method handler crashed]" module=geth 2024-07-09 09:14:01.201 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087730 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4545741080, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400dc1bb80, {0x41413580c0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x41413580c0, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x41413580b0?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x0?, 0x0?}, 0x40033d4000?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).DoCall(0x401d851408, {0x4545740c78, 0x4545740c90, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x410b207308, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/call_tx.go:351 +0xe4\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth.(PublicAPI).Call(0x401de67da0, {0x4545740c78, 0x4545740c90, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x410b207308, ...}, ...)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/api.go:291 +0x1b8\nreflect.Value.call({0x40453a1b90?, 0x40cf1e0a88?, 0x80?}, {0x2f3d5d6, 0x4}, {0x400dc1b900, 0x4, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x40453a1b90?, 0x40cf1e0a88?, 0x16?}, {0x400dc1b900?, 0x10?, 0x405f3f4008?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401de4cf60, {0x3f3a8d0, 0x4023d4ed20}, {0x411d8cd7a0, 0x8}, {0x4023d4ed70, 0x3, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x419a94fba0?, {0x3f3a8d0?, 0x4023d4ed20?}, 0x419f8a4690, 0x3?, {0x4023d4ed70?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41cdd76240, 0x416c8725a0, 0x419f8a4690)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41cdd76240, 0x416c8725a0, 0x419f8a4690)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x416c8725a0)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 114820193\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.201 time="2024-07-09T08:14:01Z" level=info msg="Served eth_call[conn 10.200.8.85:35380 reqid 26760 duration 582.963µs err method handler crashed]" module=geth 2024-07-09 09:14:01.221 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400d8795e0?}, 0x400d8795e0?) 2024-07-09 09:14:01.221 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60) 2024-07-09 09:14:01.221 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:01.221 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400d8795e0?}, 0x6?) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60, 0x0) 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4165f4af20, 0xa, 0x10}) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:01.221 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:01.221 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41cfc2f898, 0x2, 0x2?}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:01.221 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:01.221 net/http.(ServeMux).ServeHTTP(0x41cfc2fa08?, {0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:01.221 goroutine 3411 [running]: 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:01.221 2024/07/09 08:14:01 http: panic serving 127.0.0.1:57044: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:01.221 net/http.HandlerFunc.ServeHTTP(0x40eb1cbe60?, {0x3f1ce20?, 0x400d8795e0?}, 0x0?) 2024-07-09 09:14:01.221 net/http.(conn).serve.func1() 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4165f4af10?, 0x9?, 0xe24d87130f40?}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:01.221 net/http.(conn).serve(0x401cb730e0, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d80b880, {0x4165f4af20, 0xa, 0x10}) 2024-07-09 09:14:01.221 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41cfc2f898?, 0x41cfc2f7c8?, 0x959ce0?}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:01.221 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400d8795e0?}, 0x0?) 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x40b0293170, 0x12, 0x12}) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400d8795e0?}, 0x40eb1cbe60?) 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:01.221 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:01.221 /usr/local/go/src/reflect/value.go:380 +0x94 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0 2024-07-09 09:14:01.221 net/http.(conn).serve(0x401cb730e0, {0x3f3a898, 0x403d7fa210}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/service.go:188 +0x44 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc.(Server).startRPC.(Cors).Handler.func2({0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60) 2024-07-09 09:14:01.221 2024/07/09 08:14:01 http: panic serving 127.0.0.1:57044: runtime error: invalid memory address or nil pointer dereference 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/middleware/status.go:35 +0x18c 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/rs/cors@v1.9.0/cors.go:236 +0x19c 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:700 +0x54 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(service).Status(0x401c916540?, 0x3?, 0x4?) 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(Txn).Get(0x400d80b880, {0x4165f4af20, 0xa, 0x10}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:49 +0x28 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:2166 +0x38 2024-07-09 09:14:01.221 goroutine 3411 [running]: 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4165f4af10?, 0x9?, 0xe24d87130f40?}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120 2024-07-09 09:14:01.221 net/http.HandlerFunc.ServeHTTP(0x40eb1cbe60?, {0x3f1ce20?, 0x400d8795e0?}, 0x0?) 2024-07-09 09:14:01.221 reflect.Value.Call({0x2a538c0?, 0x40199cb980?, 0x5d64c00?}, {0x41cfc2f898?, 0x41cfc2f7c8?, 0x959ce0?}) 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:1898 +0xb0 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:99 +0x3dc 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPCforWS(0x40cbe841e0, {0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60, 0x0) 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x40b0293170, 0x12, 0x12}) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(handler).ServeHTTP(0x4019c96a80?, {0x3f1ce20?, 0x400d8795e0?}, 0x40eb1cbe60?) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/client.(Client).Status(0x40199f4990, {0x4f62e8?, 0x2?}) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x412d10?) 2024-07-09 09:14:01.221 net/http.HandlerFunc.ServeHTTP(0x10?, {0x3f1ce20?, 0x400d8795e0?}, 0x400d8795e0?) 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:2039 +0x508 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6) 2024-07-09 09:14:01.221 /usr/local/go/src/reflect/value.go:596 +0x970 2024-07-09 09:14:01.221 net/http.HandlerFunc.ServeHTTP(0x4000ca7450?, {0x3f1ce20?, 0x400d8795e0?}, 0x0?) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/json/handler.go:54 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:3137 +0xbc 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:2683 +0x1a4 2024-07-09 09:14:01.221 net/http.(ServeMux).ServeHTTP(0x41cfc2fa08?, {0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60) 2024-07-09 09:14:01.221 net/http.serverHandler.ServeHTTP({0x3f16278?}, {0x3f1ce20?, 0x400d8795e0?}, 0x6?) 2024-07-09 09:14:01.221 /usr/local/go/src/runtime/panic.go:770 +0x124 2024-07-09 09:14:01.221 reflect.Value.call({0x2a538c0?, 0x40199cb980?, 0x28cd900?}, {0x2f3d5d6, 0x4}, {0x41cfc2f898, 0x2, 0x2?}) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4165f4af20, 0xa, 0x10}) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231 2024-07-09 09:14:01.221 created by net/http.(Server).Serve in goroutine 3026 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80 2024-07-09 09:14:01.221 /usr/local/go/src/net/http/server.go:3285 +0x3f0 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/middleware.Status.Handler.func1.1({0x3f1ce20, 0x400d8795e0}, 0x40eb1cbe60) 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88) 2024-07-09 09:14:01.221 /home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20 2024-07-09 09:14:01.221 github.com/dgraph-io/badger/v3.(memTable).IncrRef(...) 2024-07-09 09:14:01.221 github.com/dymensionxyz/dymint/rpc/json.(handler).serveJSONRPC(...) 2024-07-09 09:14:01.221 net/http.(conn).serve.func1() 2024-07-09 09:14:01.221 panic({0x2a73ae0?, 0x59fdd20?}) 2024-07-09 09:14:01.224 time="2024-07-09T08:14:01Z" level=info msg="Served eth_getLogs[conn 10.200.8.85:20352 reqid 2049165 duration 665.489µs err method handler crashed]" module=geth 2024-07-09 09:14:01.224 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_getLogs crashed: runtime error: invalid memory address or nil pointer dereference\ngoroutine 118087734 [running]:\ngithub.com/ethereum/go-ethereum/rpc.(callback).call.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:200 +0x74\npanic({0x2a73ae0?, 0x59fdd20?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x124\ngithub.com/dgraph-io/badger/v3.(memTable).IncrRef(...)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/memtable.go:231\ngithub.com/dgraph-io/badger/v3.(DB).getMemTables(0x401730ed88)\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:696 +0x120\ngithub.com/dgraph-io/badger/v3.(DB).get(0x401730ed88, {0x4545741a10, 0x12, 0x12})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/db.go:730 +0x64\ngithub.com/dgraph-io/badger/v3.(Txn).Get(0x400e526200, {0x4141359550, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.3/txn.go:478 +0x234\ngithub.com/dymensionxyz/dymint/store.(BadgerKV).Get(0x5d64c3b?, {0x4141359550, 0xa, 0x10})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/badger.go:66 +0x80\ngithub.com/dymensionxyz/dymint/store.(PrefixKV).Get(0x4031c922a0, {0x4141359540?, 0x9?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/prefix.go:29 +0xb0\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).loadHashFromIndex(0x4018edb2c0, 0x4f96f6)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:241 +0x88\ngithub.com/dymensionxyz/dymint/store.(DefaultStore).LoadBlock(0x4018edb2c0, 0x15?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/store/store.go:95 +0x20\ngithub.com/dymensionxyz/dymint/rpc/client.(Client).Block(0x401d851408?, {0x1?, 0x1?}, 0x0?)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/dymint@v1.1.3-hotfix.1/rpc/client/client.go:419 +0x5c\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).TendermintBlockByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:184 +0x90\ngithub.com/evmos/evmos/v12/rpc/backend.(Backend).HeaderByNumber(0x401d851408, 0xffffffffffffffff)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/backend/blocks.go:293 +0x2c\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(Filter).Logs(0x400dc1bf00, {0x401e4405e0?, 0x3f57a18?}, 0x2710, 0x2710)\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/filters.go:136 +0x328\ngithub.com/evmos/evmos/v12/rpc/namespaces/ethereum/eth/filters.(PublicFilterAPI).GetLogs(0x401dae2f00, {0x3f3a8d0, 0x4023d4f130}, {0x0, 0x40c530bbe0, 0x40c530bc00, {0x4545741608, 0x1, 0x1}, {0x4195852d20, ...}})\n\t/home/ubuntu/go/pkg/mod/github.com/dymensionxyz/evmos/v12@v12.1.6-dymension-v0.4.2/rpc/namespaces/ethereum/eth/filters/api.go:550 +0x1d8\nreflect.Value.call({0x401e468600?, 0x40cf1e0f58?, 0x50?}, {0x2f3d5d6, 0x4}, {0x4023d4f1d0, 0x3, 0x125db54?})\n\t/usr/local/go/src/reflect/value.go:596 +0x970\nreflect.Value.Call({0x401e468600?, 0x40cf1e0f58?, 0x16?}, {0x4023d4f1d0?, 0x0?, 0x405f3f4808?})\n\t/usr/local/go/src/reflect/value.go:380 +0x94\ngithub.com/ethereum/go-ethereum/rpc.(callback).call(0x401e468660, {0x3f3a8d0, 0x4023d4f130}, {0x4141358c50, 0xb}, {0x4018fb6468, 0x1, 0x1257c1c?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/service.go:206 +0x2d0\ngithub.com/ethereum/go-ethereum/rpc.(handler).runMethod(0x41d8911d40?, {0x3f3a8d0?, 0x4023d4f130?}, 0x416980a000, 0x1?, {0x4018fb6468?, 0x0?, 0x0?})\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:389 +0x40\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCall(0x41c2e49d40, 0x4195852c60, 0x416980a000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:337 +0x1d8\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleCallMsg(0x41c2e49d40, 0x4195852c60, 0x416980a000)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:298 +0x80\ngithub.com/ethereum/go-ethereum/rpc.(handler).handleMsg.func1(0x4195852c60)\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:139 +0x34\ngithub.com/ethereum/go-ethereum/rpc.(handler).startCallProc.func1()\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:226 +0xbc\ncreated by github.com/ethereum/go-ethereum/rpc.(handler).startCallProc in goroutine 117232630\n\t/home/ubuntu/go/pkg/mod/github.com/evmos/go-ethereum@v1.10.26/rpc/handler.go:222 +0x84\n[]" module=geth 2024-07-09 09:14:01.224 {"lvl":"error","ts":"2024-07-09T08:14:01.222559Z","msg":"Failed to query node status","chain_name":"crynux_10000-1","chain_id":"crynux_10000-1","attempt":1,"max_attempts":5,"error":"failed to query node status: post failed: Post \"http://localhost:26657\": EOF"} 2024-07-09 09:14:01.228 time="2024-07-09T08:14:01Z" level=error msg="RPC method eth_call crashed: runti