search

aiidateam / disk-objectstore

An implementation of an efficient "object store" (actually, a key-value store) writing files on disk and not requiring a running server
https://disk-objectstore.readthedocs.io
MIT License
15 stars 8 forks source link

Include record marker in the pack file #125

Closed zhubonan closed 2 years ago

zhubonan commented 2 years ago

This is an proof-of-concept PR to show how record markers can be inserted into the pack file, which then allows reconstructing the index from the pack files along.

Not all tests are working because some involve check pack file lengths against hard-coded values.

Please feel free to give comments.

See also #124

zhubonan commented 2 years ago

Closing this PR due to robustness concerns, see #124 for more details.