Bugfixes: handling of malformed databases, iterators and indexes - Githubissues

reverbrain / eblob

Eblob is an append-only low-level IO library, which saves data in blob files. Created as low-level backend for elliptics

GNU Lesser General Public License v3.0

104 stars 29 forks source link

Bugfixes: handling of malformed databases, iterators and indexes #33

Closed SaveTheRbtz closed 11 years ago

SaveTheRbtz commented 11 years ago

Iterators:

Propagate internal and external iterator errors to caller:
This fixes incomplete data-sorts and recoveries in case of badly corrupted indexes.

Indexes:

Check index entries on start to avoid startup with broken indexes:
We ignore minor index corruptions and in case of fatal errors we bail out, print diagnostics and fail eblob_init.

Misc:

Fixed eblob_total_elements:
Now it returns difference between total number of entries in database and number of removed entries;
Various bugfixes and sanity checks.

PS. This pull request introduces some non-trivial changes in iteration/startup that should be carefully tested.