Closed xuyenvuong closed 4 years ago
Seems like after restart the slasher, the above log errors was no longer there. I was only observing for about 10 mins of slasher log now, seems like it is back to normal.
time="2020-08-21 21:31:20" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=5663 root=0xbe3a22023d30845f... slot=124956 time="2020-08-21 21:31:59" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=27406 root=0xd387d26c24107c99... slot=124959 time="2020-08-21 21:32:22" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=29720 root=0x3eb471277aec30d0... slot=124961 time="2020-08-21 21:32:33" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=8118 root=0xca77f1bb502e3670... slot=124962 time="2020-08-21 21:32:46" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=28178 root=0x13617a45dd1abb06... slot=124963 time="2020-08-21 21:32:57" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=23744 root=0xbd5c460328307f5c... slot=124964 time="2020-08-21 21:33:20" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=6221 root=0x4134f61cd3c7eec4... slot=124966
Scratch my previous comment. Spoke too soon. The problem is back and identical.
$ tail -n 200 logs/slasher.log time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19176]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19464]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19767]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19921]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [19989]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [21034]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [21247 24706]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [21258]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [23510]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [23623]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [23754]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24063 25053]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24102]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24591]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24623]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [24867]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [25247]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [26904]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [27240]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [27324]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [27874]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [29073]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [433]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:49" level=error msg="Could not submit attester slashing with indices [478 24493]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [572]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [710]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [787]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [833]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [2081]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [2344]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [2656]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [5944]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [8011]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [8948]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [9161]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [9530 23228 24393]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [9768]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [10588]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [10850]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [12190]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [12390 16639]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [13445]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [13913]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [13952]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [14571]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [16645]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [17602]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [17899]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [17973]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [18084]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [18505]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [18543 27073]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [19027 19346]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [19458]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [19744]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [21121]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [21733]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [21878]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [24028]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [24459]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:50" level=error msg="Could not submit attester slashing with indices [24539]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [24908]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [26221]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [26850]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [26913]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [27885]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [245]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [295]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [575]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [2154 23499]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [2435]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [4721]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [4760]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [4802]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [5094]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [6011]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [7135]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [8061]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [8924]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [11855]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [12145 17878]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [13912]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [14168 14352]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [14553]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [15130 22711]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [15339]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [16337]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [18124]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [19248]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [19385]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [20607]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [20841]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21116]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21146]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21201]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:51" level=error msg="Could not submit attester slashing with indices [21901]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [22926]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [23479]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [23709]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [25215]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [26475]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [26545]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [27050]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [28230]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [5087]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [5695]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [5751]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [198]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [322]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [515 25283]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [534]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [607 26429]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [842]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [2306]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [2342]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [2431]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [4625]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [4778]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [7512 24899]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [8066]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [8410]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [9055]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [10593 22913]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [11165]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13153]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13353]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13830 28265]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [13885 26232]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [14445]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [15369]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [17954]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:52" level=error msg="Could not submit attester slashing with indices [18003]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19223]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19241]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19382]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19619]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19980]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19990]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [19995]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [20887]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [21545]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [23089]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [23149]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [23278]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24362]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24389]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24504]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [24828]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [26222]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [26719]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [27230]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [27378]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [27431]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [28039]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [28609]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [28817]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [29676 29679]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [64]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [243]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [554]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [686]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [948]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [4472]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:53" level=error msg="Could not submit attester slashing with indices [4638]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [4701]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [4918 8746]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7532]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7796]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7932]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7957]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [7982]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [8596]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [8865]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [9050 23596]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [10884]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [12194]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [12222]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [12555]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [14338 19519]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [14597]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [14801]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [15180]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [15301]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [15526 23801]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [16696]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [19269]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [21645]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [22049 23657]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [22826]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23091]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23187]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23585]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [23723]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [24776]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [24969]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [24973]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [25349]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [26421]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [26967]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient time="2020-08-23 07:12:54" level=error msg="Could not submit attester slashing with indices [27342]" error="rpc error: code = Internal desc = Could not insert attester slashing into pool: could not verify attester slashing: could not validate indexed attestation: signature did not verify" prefix=beaconclient
Symptom is now gone after I:
time="2020-08-23 19:15:45" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=30305 root=0x1e638ec4b087907d... slot=138678 time="2020-08-23 19:15:56" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=4390 root=0xfc9ceb5ed46e3e88... slot=138679 time="2020-08-23 19:16:21" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=13441 root=0xae1de9f05802596a... slot=138681 time="2020-08-23 19:16:32" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=34447 root=0xa18994aeee5db715... slot=138682 time="2020-08-23 19:16:46" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=34599 root=0xd30b38ba5dda740e... slot=138683 time="2020-08-23 19:16:59" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=5561 root=0x70a342d4cce1d616... slot=138684 time="2020-08-23 19:17:08" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=34685 root=0x3a890ee963c40f95... slot=138685 time="2020-08-23 19:17:21" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=28619 root=0xba55513ce4f536fe... slot=138686 time="2020-08-23 19:18:03" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=21936 root=0xc1a5656ba6bb0c45... slot=138689 time="2020-08-23 19:18:22" level=info msg="Received block from beacon node" prefix=beaconclient proposer_index=33978 root=0x0cce6349d482e586... slot=138691
Hmm... this is back again. Same issue. Very hard to nail down to the root cause. This is not good if happening on mainnet.
Removing the slasher.db seems to stabilized slasher. I will attach the backup slasher.db.bak asap.
-rw------- 1 ethereum ethereum 13746176 Aug 24 23:17 slasher.db -rw------- 1 ethereum ethereum 17887174656 Aug 24 21:18 slasher.db.bak
The slasher.db was up to 17GB - This is quite huge.
slasher.db.bak 100% 17GB 10.4MB/s 27:25
I could zip it down to 8GB. Still quite large, but let me know if you guys still need it.
Slasher is still running very stable since the db removed.
i think it was some testnet instability (branches that resulted in different committees) wdyt @0xKiwi ?
@shayzluf what should we do about this issue? Is there a resolution for slasher to handle the situation where there are forks with different committees? Let's find a path to closing this one
Slasher doesn't know about committees. I think the only thing that could lead to this outcome is somthing that goes wrong in convert to indexed
I will look in our logs to see if it still happens
This was likely due to a fork and caches in our beacon node which did not use roots and simply slots as keys. This has no longer been observed in the wild
π Bug Report
Description
Slasher producing so much error per second after got enabled after 66% participation rate. Not sure if these indices are repeated in the log. I will update asap after comb a bit more thru the log. ### Has this worked before in a previous version? Yes, however this issue seems like it has to do with the recent roughtime incident ## π¬ Minimal Reproduction 1. Turn off slasher so that beacon-chain can reach to head 2. Wait until beacon-chain reaches to head and validators start to attest, then turn on slasher 3. Observing the slasher log. ## π₯ Errorπ Your Environment
Operating System: Pi 4B 8GB Ubuntu latest
What version of Prysm are you running? (Which release) alpha.23
Anything else relevant (validator index / public key)? https://medalla.beaconcha.in/dashboard?validators=12425,12433,12437,12442,12446,12456,12457,12461,12465,12469,12473,12474,12477,12480,12487,12490,12493,12499,12504,12509,12511,12516,12521,12525,12527,12532,12542,12544,12552,12567,12568,12569,12574