nucypher / zerodb

*This project is no longer actively maintained. If you'd like to become the maintainer, please let us know.* ZeroDB is an end-to-end encrypted database. Data can be stored and queried on untrusted database servers without ever exposing the encryption key. Clients can execute remote queries against the encrypted data without downloading all of it or suffering an excessive performance hit.
GNU Affero General Public License v3.0
1.56k stars 102 forks source link

Make bulk-indexing for fulltext search more effective #42

Open michwill opened 8 years ago

michwill commented 8 years ago

When indexing multiple texts at once, it makes a lot of sense to go word-by word, for performance reasons (in comparison with indexing text-by-text). It ends up in less decryption operations, plus it is possible to index in a process pool without creating any conflicts outside the pool