Closed nlp4whp closed 4 years ago
Thanks for the merge request, looks like useful functionality and fits nicely with the rest. This will help with performance, but it might be worthwhile to investigate making it perform faster on larger corpuses, which should be feasible.
Hi, I add a new function named
get_batch_scores
to compute score between query and a subset of all corpus; becauseget_scores
is a little bit slow when user pass huge number ofcorpus
into bm25 model; For instance, my corpus includes about 40w docs, andget_scores
will cost more than 1 second,