raphaelsty / cherche

Neural Search
MIT License
324 stars 14 forks source link

is this just build new index and skip the index before? #19

Closed fivejjs closed 11 months ago

fivejjs commented 11 months ago

https://github.com/raphaelsty/cherche/blob/6aabe70853d2486ee1972e1689290fdce8b72587/cherche/index/faiss_index.py#L107C13-L107C64

raphaelsty commented 11 months ago

Hi @fivejjs, the function you are linking check if there is already a Faiss Index. It not, it create one. If there is a Faiss Index, this function do nothing except adding embeddings to the existing index

All retrievers with an add method are "online" and won't re-create an index from scratch

image