search

mosuka / blast

Blast is a full text search and indexing server, written in Go, built on top of Bleve.
Apache License 2.0
1.08k stars 75 forks source link

Snapshotting and Chaos Testing #140

Open jkassis opened 3 years ago

jkassis commented 3 years ago

Are you sure that the snapshotting mechanism is transactional / point in time? Have you chaos tested this?

Reviewing the code. Index.SnapshotItems() returns a channel that delivers each document in the index. Internally, that calls Bleve Index.Index.DocIDReaderAll, which does not guarantee a snapshot.

Perhaps the raft is paused at this point?

image

jkassis commented 3 years ago

see https://github.com/blevesearch/bleve/issues/1396

mosuka commented 3 years ago

Hi @jkassis ,

Thanks for letting me know. Blast has not yet been fully tested due to the PoC stage. I'll check out the bleve issue you posted. Thanks.