Render.com fail building wheel for nmslib

[soderalohastrom]

Happens when requirements.txt has any of the following: rerankers[gpt] rerankers[rankllm] rerankers[all]

• seemingly since v0.3.0

  from nmslib.cc:16: /usr/local/include/python3.11/pytypedefs.h:22:16: note: forward declaration of ‘PyFrameObject’ {aka ‘struct _frame’} typedef struct _frame PyFrameObject; ^~ error: command '/usr/bin/gcc' failed with exit code 1 [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for nmslib ERROR: Could not build wheels for nmslib, which is required to install pyproject.toml-based projects ==> Build failed 😞

[jolackner]

I have the same issue when my streamlit app requirements.txt has either rerankers[rankllm] or rerankers[all]

[bclavie]

Hey! Thanks guys for flagging. It seems like an old nmslib issue that appeared to have been resolved has returned. I'll try and tweak the requirements to something that works, either a fork of nmslib (as suggested by https://github.com/AnswerDotAI/rerankers/issues/15) or seeing if there's an elegant way to make it install properly again.

[bclavie]

Just as a bit of an update on the current situation with nmslib: it's actually fairly hard to find a workaround for the nmslib install issues on mac, as well as conditionally installing the metabrainz fork -- any workaround seems to result in a slightly different, but just as breaking, issue.

nmslib should be supporting higher versions of python soon, and RankLLM is one of the least used rerankers in this library at the moment, so my plan is probably something as basic as taking it out of [all] requirements and displaying a warning message that it couldn't be installed to nmslib and that you should install the fork if you're on recent python versions, which we'd take away once the new nmslib version is out!