jina-ai / executors

internal-only
Apache License 2.0
31 stars 12 forks source link

docs: add warning to simple indexer #100

Closed jakobkruse1 closed 3 years ago

jakobkruse1 commented 3 years ago

The simple indexer is currently experiencing a bug when running it with docker jinahub+docker://SimpleIndexer. After closing the docker container, it sometimes happens that the stored memmap which is mounted into the container is corrupted. After data, the entire index is broken and the user needs to index from scratch.

The error does not happen when using jinahub://SimpleIndexer which is why I quickly changed the README to make the user aware of this problem.

tadejsv commented 3 years ago

Any idea on how/why this corruption happens?