Explore tantivy for indexing and searching multiple files

esrlabs / chipmunk

log analysis tool

Apache License 2.0

553 stars 39 forks source link

Closed marcmo closed 1 month ago

marcmo commented 4 months ago

[ ] explore architecture of tantivy
[ ] create benchmark with 100 files with 100 MB
- [ ] time to index everything
- [ ] time to search for a filter
- [ ] time to search for a regex

itsmesamster commented 2 months ago

itsmesamster commented 1 month ago

Benchmarks done. Sample implementation will be added to https://github.com/esrlabs/chipmunk-research.