Benchmark using CountMinSketch on character n-grams for text indexing

locationtech / geowave

GeoWave provides geospatial and temporal indexing on top of Accumulo, HBase, BigTable, Cassandra, Kudu, Redis, RocksDB, and DynamoDB.

Apache License 2.0

501 stars 190 forks source link

Benchmark using CountMinSketch on character n-grams for text indexing #1783

Open rfecher opened 3 years ago

rfecher commented 3 years ago

It should be an improvement to use CountMinSketch as an index stat for text indicies and then for terms that are longer than the "n" for the n-gram we can choose the n-gram within the term that has the smallest estimated cardinality.