prysmaticlabs / prysm

Go implementation of Ethereum proof of stake
https://www.offchainlabs.com
GNU General Public License v3.0
3.47k stars 1.01k forks source link

Slasher: Could not submit attester slashing with indices [xxxxxx] #7073

Closed xuyenvuong closed 4 years ago

xuyenvuong commented 4 years ago

🐞 Bug Report

Description

Slasher producing so much error per second after got enabled after 66% participation rate. Not sure if these indices are repeated in the log. I will update asap after comb a bit more thru the log. ### Has this worked before in a previous version? Yes, however this issue seems like it has to do with the recent roughtime incident ## πŸ”¬ Minimal Reproduction 1. Turn off slasher so that beacon-chain can reach to head 2. Wait until beacon-chain reaches to head and validators start to attest, then turn on slasher 3. Observing the slasher log. ## πŸ”₯ Error


The last 200 errors:

ethereum@ethnode-d815b1b5f:~$ tail -n 200 logs/slasher.log time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [2376]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [2598 24651]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=2929 root=0x758db8734297d268... slot=101593 time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [2706]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [4396]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [4532]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [5193]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [5284]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [7475]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [7977]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [8029]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [8422]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [8622]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [8755 22558]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [9155]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [9293]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [9636]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [11259]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [11855]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [12048]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [13517]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [13782]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [14342]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [14994]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [15111]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:10" level=error msg="Could not submit attester slashing with indices [15361]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [16186]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [16736]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [19340]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [19830 24404]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [20235]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [20659]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=18923 root=0xf213ec329702874e... slot=101595 time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [20798]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [21068]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [21070]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [21415]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [21917]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [23832]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [25092]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [25587]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [25711]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [25727]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [25824]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [26232]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [27738]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [28256]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [444 19874]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [545]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [1452]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [1613]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [1811 16799]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [2027]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:11" level=error msg="Could not submit attester slashing with indices [2068]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [2074]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [2084]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=43 root=0x42a7a64c824311f1... slot=101596 time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [2385]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [2551 28813]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [4592 19987]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [4673]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [5099]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=1554 root=0xb4e4016c233a89e3... slot=101597 time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [7540 20415]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [8032 29112]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [8479]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [8731]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [9003]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [9066 28616]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [9362]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [9380]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [12562]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [13467]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [13471]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [13875]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [14261]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [14269]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [14414]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [14421]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [14520]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [15416]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [15493]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:12" level=error msg="Could not submit attester slashing with indices [16942 26499]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [19586]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [20795]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [21698]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [22170]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [23516]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [23569]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [23640]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [23760]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [23803]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [24156]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [25275]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [25283]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [26421]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [27677]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [27892]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [28138]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [28244]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [10]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [94]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [124]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [191]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [201]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [289]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [485]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=10163 root=0xd70386ecf6f2b040... slot=101602 time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [901]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [4921]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [6014]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [7779]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [7788]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [7884]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:13" level=error msg="Could not submit attester slashing with indices [8877]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [9113]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [9213]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [10675]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [11840]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [12424]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [12606]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [13469 13492]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [13524]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [13605]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [13807]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [14151]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [14225]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [14313]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [14723]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [15181]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [15349]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [15422]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [15447]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [15524]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [15831]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [18590]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [20730]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [20827 29592]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [21052 21922]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [22107]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [22203]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [22831]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [22971]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [23480]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=8093 root=0x52953fd9db9a8913... slot=101606 time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [23777]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [24629]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [24784]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [25125]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [25290]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [26494]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:14" level=error msg="Could not submit attester slashing with indices [27681]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [29012]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [97 28015]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [180]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [278]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [425]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [1022]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [1971]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [2030]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [2197]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [4414]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [4577]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [5138]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [5235]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=15792 root=0x008b339e79edf1a8... slot=101607 time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [6115]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [7756]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [8404]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [8428 20821]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [9540]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [9762]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [11074 28611]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [12206 23515 29520]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [12233]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [12308]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [13766]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [13940]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [14007]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [14256]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [14448]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [14589]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [14869]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [15068]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [15082]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [15553]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [15590]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [16509 21945]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [19491]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:15" level=error msg="Could not submit attester slashing with indices [19515]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [19740]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [20696]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [21294]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [21357]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [22180]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [22254]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [22440]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [23103]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [23300]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-21 05:07:16" level=error msg="Could not submit attester slashing with indices [23501]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient

🌍 Your Environment

Operating System: Pi 4B 8GB Ubuntu latest

  

  

What version of Prysm are you running? (Which release) alpha.23

  

  

Anything else relevant (validator index / public key)? https://medalla.beaconcha.in/dashboard?validators=12425,12433,12437,12442,12446,12456,12457,12461,12465,12469,12473,12474,12477,12480,12487,12490,12493,12499,12504,12509,12511,12516,12521,12525,12527,12532,12542,12544,12552,12567,12568,12569,12574

xuyenvuong commented 4 years ago

Seems like after restart the slasher, the above log errors was no longer there. I was only observing for about 10 mins of slasher log now, seems like it is back to normal.

time="2020-08-21 21:31:20" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=5663 root=0xbe3a22023d30845f... slot=124956 time="2020-08-21 21:31:59" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=27406 root=0xd387d26c24107c99... slot=124959 time="2020-08-21 21:32:22" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=29720 root=0x3eb471277aec30d0... slot=124961 time="2020-08-21 21:32:33" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=8118 root=0xca77f1bb502e3670... slot=124962 time="2020-08-21 21:32:46" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=28178 root=0x13617a45dd1abb06... slot=124963 time="2020-08-21 21:32:57" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=23744 root=0xbd5c460328307f5c... slot=124964 time="2020-08-21 21:33:20" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=6221 root=0x4134f61cd3c7eec4... slot=124966

xuyenvuong commented 4 years ago

Scratch my previous comment. Spoke too soon. The problem is back and identical.

xuyenvuong commented 4 years ago

$ tail -n 200 logs/slasher.log time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19176]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19464]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19767]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19921]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19989]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [21034]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [21247 24706]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [21258]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [23510]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [23623]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [23754]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24063 25053]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24102]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24591]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24623]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24867]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [25247]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [26904]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [27240]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [27324]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [27874]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [29073]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [433]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [478 24493]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [572]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [710]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [787]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [833]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [2081]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [2344]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [2656]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [5944]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [8011]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [8948]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [9161]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [9530 23228 24393]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [9768]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [10588]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [10850]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [12190]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [12390 16639]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [13445]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [13913]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [13952]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [14571]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [16645]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [17602]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [17899]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [17973]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [18084]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [18505]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [18543 27073]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [19027 19346]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [19458]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [19744]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [21121]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [21733]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [21878]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [24028]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [24459]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [24539]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [24908]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [26221]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [26850]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [26913]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [27885]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [245]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [295]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [575]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [2154 23499]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [2435]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [4721]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [4760]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [4802]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [5094]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [6011]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [7135]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [8061]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [8924]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [11855]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [12145 17878]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [13912]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [14168 14352]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [14553]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [15130 22711]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [15339]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [16337]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [18124]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [19248]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [19385]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [20607]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [20841]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21116]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21146]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21201]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21901]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [22926]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [23479]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [23709]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [25215]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [26475]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [26545]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [27050]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [28230]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [5087]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [5695]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [5751]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [198]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [322]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [515 25283]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [534]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [607 26429]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [842]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [2306]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [2342]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [2431]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [4625]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [4778]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [7512 24899]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [8066]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [8410]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [9055]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [10593 22913]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [11165]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13153]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13353]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13830 28265]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13885 26232]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [14445]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [15369]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [17954]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [18003]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19223]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19241]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19382]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19619]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19980]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19990]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19995]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [20887]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [21545]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [23089]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [23149]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [23278]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24362]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24389]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24504]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24828]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [26222]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [26719]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [27230]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [27378]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [27431]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [28039]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [28609]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [28817]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [29676 29679]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [64]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [243]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [554]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [686]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [948]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [4472]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [4638]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [4701]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [4918 8746]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7532]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7796]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7932]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7957]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7982]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [8596]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [8865]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [9050 23596]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [10884]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [12194]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [12222]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [12555]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [14338 19519]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [14597]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [14801]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [15180]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [15301]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [15526 23801]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [16696]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [19269]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [21645]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [22049 23657]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [22826]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23091]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23187]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23585]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23723]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [24776]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [24969]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [24973]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [25349]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [26421]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [26967]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [27342]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient

xuyenvuong commented 4 years ago

Symptom is now gone after I:

  1. Restart beacon-chain, lower the number of max peers from 500 down to 100.
  2. Restart Slasher

time="2020-08-23 19:15:45" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=30305 root=0x1e638ec4b087907d... slot=138678 time="2020-08-23 19:15:56" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=4390 root=0xfc9ceb5ed46e3e88... slot=138679 time="2020-08-23 19:16:21" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=13441 root=0xae1de9f05802596a... slot=138681 time="2020-08-23 19:16:32" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=34447 root=0xa18994aeee5db715... slot=138682 time="2020-08-23 19:16:46" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=34599 root=0xd30b38ba5dda740e... slot=138683 time="2020-08-23 19:16:59" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=5561 root=0x70a342d4cce1d616... slot=138684 time="2020-08-23 19:17:08" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=34685 root=0x3a890ee963c40f95... slot=138685 time="2020-08-23 19:17:21" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=28619 root=0xba55513ce4f536fe... slot=138686 time="2020-08-23 19:18:03" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=21936 root=0xc1a5656ba6bb0c45... slot=138689 time="2020-08-23 19:18:22" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=33978 root=0x0cce6349d482e586... slot=138691

xuyenvuong commented 4 years ago

Hmm... this is back again. Same issue. Very hard to nail down to the root cause. This is not good if happening on mainnet.

xuyenvuong commented 4 years ago

Removing the slasher.db seems to stabilized slasher. I will attach the backup slasher.db.bak asap.

-rw------- 1 ethereum ethereum 13746176 Aug 24 23:17 slasher.db -rw------- 1 ethereum ethereum 17887174656 Aug 24 21:18 slasher.db.bak

xuyenvuong commented 4 years ago

The slasher.db was up to 17GB - This is quite huge.

slasher.db.bak 100% 17GB 10.4MB/s 27:25

I could zip it down to 8GB. Still quite large, but let me know if you guys still need it.

xuyenvuong commented 4 years ago

Slasher is still running very stable since the db removed.

shayzluf commented 4 years ago

i think it was some testnet instability (branches that resulted in different committees) wdyt @0xKiwi ?

rauljordan commented 4 years ago

@shayzluf what should we do about this issue? Is there a resolution for slasher to handle the situation where there are forks with different committees? Let's find a path to closing this one

shayzluf commented 4 years ago

Slasher doesn't know about committees. I think the only thing that could lead to this outcome is somthing that goes wrong in convert to indexed

shayzluf commented 4 years ago

I will look in our logs to see if it still happens

rauljordan commented 4 years ago

This was likely due to a fork and caches in our beacon node which did not use roots and simply slots as keys. This has no longer been observed in the wild