search

ssbc / go-ssb

Go implementation of ssb (work in progress!)
https://scuttlebutt.nz
162 stars 26 forks source link

heaps of ebt ValidateNext() errors #134

Open ahdinosaur opened 2 years ago

ahdinosaur commented 2 years ago

hi :smiley_cat:

i tried upgrading from the node pub to the go pub: https://github.com/cryptoscope/ssb/issues/121

i used ssb-offset-converter, but seems ebt replication isn't working, there's a repeating pattern of error messages.

logs snippet:

Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.104607103s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(687) != curr.seq+1 (skip: false)"
Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.105221891s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(688) != curr.seq+1 (skip: false)"
Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.105822806s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(689) != curr.seq+1 (skip: false)"
Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.106506111s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(690) != curr.seq+1 (skip: false)"
Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.107113435s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(691) != curr.seq+1 (skip: false)"
Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.107726991s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(692) != curr.seq+1 (skip: false)"
Jan 09 20:01:11 ssb ssb-server[30218]: level=error t=6h44m10.108564747s plugin=ebt error="ValidateNext(<@2iyg.ed25519>:83): next.seq(693) != curr.seq+1 (skip: false)"
ahdinosaur commented 2 years ago

i tried removing the logs and re-sync-ing from just the secret and a manual connection, but that didn't seem to work either..

ahdinosaur commented 2 years ago

okay, starting over and disabling ebt seems to be working. but i hope i'm just doing something wrong.

ahdinosaur commented 2 years ago

tried again with a converted db (after using legacy replication for a time), no luck:

go-sbot.log

cblgh commented 2 years ago

Hi @ahdinosaur!

I can't speak for @cryptix, but if I remember correctly EBT was very experimental before the NGI project started. I believe it was significantly improved upon over the course of the project, but as you've been noticing, there might be more to do.

It feels bad to send you on a wild goose chase, but I figure I should mention that there's a still open PR that might have some fixes on the EBT front: https://github.com/cryptoscope/ssb/pull/111

Wish I could help you more, but I never touched the EBT guts; I'm but a fledgling gopher in this project 👶

mhfowler commented 2 years ago

fwiw the pub that I tried to migrate from node-pub to go-pub is also still not working (https://github.com/cryptoscope/ssb/issues/126). Maybe I should try disabling EBT for it as well (or maybe its an unrelated issue)

cryptix commented 2 years ago

That's odd... I haven't seen these in a long time and not from clean slate...

@ahdinosaur can you try running with -fsck sequence? If that finds any error you need to run that again with -repair, too.

If it doesn't find a problem with any of the feeds, please try deleting the ebt-state-matrix folder in the repo ($HOME/.ssb-go by default)