search

xhluca / bm25s

Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
https://bm25s.github.io
MIT License
920 stars 39 forks source link

Is it possible to incrementally add corpus to a retriever? #74

Closed ANYMS-A closed 1 month ago

ANYMS-A commented 1 month ago

Hi, currently I have a lot of corpus which I dont want to load them all into the memory and use

retriever.save("bm25s_very_big_index", corpus=corpus)

to create the retriever.

Is it possible to incrementally add corpus to a retriever? Thanks!