Implement full text search engine

OkamiIO / Nomure

A proof-of-concept graph Database on top of FoundationDB

11 stars 1 forks source link

Implement full text search engine #2

Open WolfDan opened 5 years ago

WolfDan commented 5 years ago

Sadly I'm don't know too much about string index/searching/match algorithms so I need to rely on another solutions for it, since is an important part of any database

Tantivy looks really promising since works like lucene so is plugable, I need to explore the futher posibilities

The FDB record layer implements a full text search indexing technique whichs I think I can use it natively, so I can have all in a single place

WolfDan commented 5 years ago

Alex answered my question regarding this, I'd prefer a naive solution, so check this later

https://forums.foundationdb.org/t/understanding-text-index-on-fdb-record-layer/1073

WolfDan commented 5 years ago

I've started research on this, I'll use rust in order to do the stemming, tokenizing, stop word etc...

On stand by while finish the rewrite

WolfDan commented 5 years ago

Tho I tried to do it, is way more complex that I tought, for the moment I'm not going to implement it

I'll priorize the core features