search

AnswerDotAI / rerankers

A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
Apache License 2.0
1.04k stars 57 forks source link

Installation issues #15

Closed excubo-jg closed 3 months ago

excubo-jg commented 5 months ago

If I run pip install "rerankers[all]" I get this error: ERROR: Could not build wheels for nmslib, which is required to install pyproject.toml-based projects

Sequentially applying the install options, pip install "rerankers[rankllm]" fails with this message. It seems that nmslib is only maintained until python 3.8 (there is a fork nmslib-metabrainz which supports newer python versions). The rankers readme though states '# Note: RankLLM is only supported on Python 3.10+! This will not work with Python 3.9 so I am not sure how to resolve this.

Also pip install "rerankers[fastrank]" gives this warning message: WARNING: rerankers 0.3.0 does not provide the extra 'fastrank'

bclavie commented 5 months ago

Thanks for flagging this!

Also pip install "rerankers[fastrank]" gives this warning message: WARNING: rerankers 0.3.0 does not provide the extra 'fastrank'

Whoops, this should say flashrank, it's a pretty big mistake that I let slip onto the README!

Re: the nmslib issue, it's quite odd. This is an error I used to get in the past on M-chips Macs, that went away eventually, but I just uninstalled nmslib in an environment that (previously) built it fine and the error is back. I will try and figure out an elegant way to fallback to the metabrainz fork if I can't find another way to make it install fine.

bclavie commented 3 months ago

Hey, closing this and centralising issues around nmslib on the other issue (sadly no resolution for now).