search

neuml / txtai

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
https://neuml.github.io/txtai
Apache License 2.0
8.72k stars 576 forks source link

Segmentation fault on arm64 macOS while searching embeddings index #350

Closed laurids-reichardt closed 1 year ago

laurids-reichardt commented 1 year ago

Searching an embeddings index, like demoed in the first txtai example, seems to lead to a segmentation fault on Apple Silicon hardware. This is the script I'm executing:

from txtai.embeddings import Embeddings

# Create embeddings model, backed by sentence-transformers & transformers
embeddings = Embeddings({"path": "sentence-transformers/nli-mpnet-base-v2"})

data = [
    "US tops 5 million confirmed virus cases",
    "Canada's last fully intact ice shelf has suddenly collapsed, forming a Manhattan-sized iceberg",
    "Beijing mobilises invasion craft along coast as Taiwan tensions escalate",
    "The National Park Service warns against sacrificing slower friends in a bear attack",
    "Maine man wins $1M from $25 lottery ticket",
    "Make huge profits without work, earn up to $100,000 a day",
]

print("%-20s %s" % ("Query", "Best Match"))
print("-" * 50)

for query in (
    "feel good story",
    "climate change",
    "public health story",
    "war",
    "wildlife",
    "asia",
    "lucky",
    "dishonest junk",
):
    # Get index of best section that best matches query
    uid = embeddings.similarity(query, data)[0][0]

    print("%-20s %s" % (query, data[uid]))

# Create an index for the list of text
embeddings.index([(uid, text, None) for uid, text in enumerate(data)])

print("%-20s %s" % ("Query", "Best Match"))
print("-" * 50)

# Run an embeddings search for each query
for query in (
    "feel good story",
    "climate change",
    "public health story",
    "war",
    "wildlife",
    "asia",
    "lucky",
    "dishonest junk",
):
    # Extract uid of first result
    # search result format: (uid, score)
    uid = embeddings.search(query, 1)[0][0]

    # Print text
    print("%-20s %s" % (query, data[uid]))

Output:

❯ python src/nlp/textai_segfault.py 
Query                Best Match
--------------------------------------------------
feel good story      Maine man wins $1M from $25 lottery ticket
climate change       Canada's last fully intact ice shelf has suddenly collapsed, forming a Manhattan-sized iceberg
public health story  US tops 5 million confirmed virus cases
war                  Beijing mobilises invasion craft along coast as Taiwan tensions escalate
wildlife             The National Park Service warns against sacrificing slower friends in a bear attack
asia                 Beijing mobilises invasion craft along coast as Taiwan tensions escalate
lucky                Maine man wins $1M from $25 lottery ticket
dishonest junk       Make huge profits without work, earn up to $100,000 a day
Query                Best Match
--------------------------------------------------
[1]    10762 segmentation fault  python src/nlp/textai_segfault.py

Enviroment:

# Name                    Version                   Build  Channel
aiohttp                   3.8.3            py39h02fc5c5_0    conda-forge
aiosignal                 1.2.0              pyhd8ed1ab_0    conda-forge
annoy                     1.17.1                   pypi_0    pypi
anyio                     3.6.1              pyhd8ed1ab_1    conda-forge
aom                       3.4.0                hbe31e94_1    conda-forge
apache-libcloud           3.6.0                    pypi_0    pypi
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
appnope                   0.1.3              pyhd8ed1ab_0    conda-forge
arrow-cpp                 9.0.0           py39h2880af6_6_cpu    conda-forge
asttokens                 2.0.8              pyhd8ed1ab_0    conda-forge
async-timeout             4.0.2              pyhd8ed1ab_0    conda-forge
attrs                     22.1.0             pyh71513ae_1    conda-forge
aws-c-cal                 0.5.11               h4530763_0    conda-forge
aws-c-common              0.6.2                h3422bc3_0    conda-forge
aws-c-event-stream        0.2.7               h9972306_13    conda-forge
aws-c-io                  0.10.5               hea86ef8_0    conda-forge
aws-checksums             0.1.11               h487e1a8_7    conda-forge
aws-sdk-cpp               1.8.186              hb86bbe7_3    conda-forge
backcall                  0.2.0              pyh9f0ad1d_0    conda-forge
backports                 1.0                        py_2    conda-forge
backports.functools_lru_cache 1.6.4              pyhd8ed1ab_0    conda-forge
beautifulsoup4            4.11.1                   pypi_0    pypi
black                     22.6.0             pyhd8ed1ab_0    conda-forge
boto3                     1.24.84            pyhd8ed1ab_0    conda-forge
botocore                  1.27.84            pyhd8ed1ab_0    conda-forge
brotlipy                  0.7.0           py39hb18efdd_1004    conda-forge
bzip2                     1.0.8                h3422bc3_4    conda-forge
c-ares                    1.18.1               h3422bc3_0    conda-forge
ca-certificates           2022.9.24            h4653dfc_0    conda-forge
cachecontrol              0.12.11            pyhd8ed1ab_0    conda-forge
cachy                     0.3.0                      py_0    conda-forge
certifi                   2022.9.24          pyhd8ed1ab_0    conda-forge
cffi                      1.15.1           py39h04d3946_0    conda-forge
charset-normalizer        2.1.1              pyhd8ed1ab_0    conda-forge
cleo                      0.8.1              pyhd8ed1ab_2    conda-forge
click                     8.1.3            py39h2804cbe_0    conda-forge
click-default-group       1.2.2              pyhd8ed1ab_1    conda-forge
clikit                    0.6.2              pyh9f0ad1d_0    conda-forge
colorama                  0.4.5              pyhd8ed1ab_0    conda-forge
coloredlogs               15.0.1                   pypi_0    pypi
commonmark                0.9.1                    pypi_0    pypi
conda                     22.9.0           py39h2804cbe_1    conda-forge
conda-lock                1.1.1              pyhd8ed1ab_0    conda-forge
conda-package-handling    1.9.0            py39h02fc5c5_0    conda-forge
crashtest                 0.3.1              pyhd8ed1ab_0    conda-forge
croniter                  1.3.7                    pypi_0    pypi
cryptography              37.0.4           py39h4cb6239_0    conda-forge
dataclasses               0.8                pyhc8e2a94_3    conda-forge
datasets                  2.5.1              pyhd8ed1ab_0    conda-forge
debugpy                   1.6.3            py39h3c22d25_0    conda-forge
decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
devtools                  0.9.0                    pypi_0    pypi
dill                      0.3.5.1            pyhd8ed1ab_0    conda-forge
distlib                   0.3.5              pyhd8ed1ab_0    conda-forge
ensureconda               1.4.3              pyhd8ed1ab_0    conda-forge
entrypoints               0.4                pyhd8ed1ab_0    conda-forge
et-xmlfile                1.1.0                    pypi_0    pypi
executing                 0.10.0                   pypi_0    pypi
expat                     2.4.9                hb7217d7_0    conda-forge
faiss-cpu                 1.7.2                    pypi_0    pypi
fastapi                   0.85.0                   pypi_0    pypi
fasteners                 0.18                     pypi_0    pypi
fasttext                  0.9.2                    pypi_0    pypi
ffmpeg                    5.1.1           gpl_hfdc7bce_101    conda-forge
filelock                  3.8.0              pyhd8ed1ab_0    conda-forge
flatbuffers               22.9.24                  pypi_0    pypi
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
fontconfig                2.14.0               h82840c6_1    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
freetype                  2.12.1               hd633e50_0    conda-forge
frozenlist                1.3.1            py39h4eb3d34_0    conda-forge
fsspec                    2022.8.2           pyhd8ed1ab_0    conda-forge
gettext                   0.19.8.1          h0186832_1009    conda-forge
gflags                    2.2.2             hc88da5d_1004    conda-forge
glog                      0.6.0                h6da1cb0_0    conda-forge
gmp                       6.2.1                h9f76cd9_0    conda-forge
gnutls                    3.7.8                h9f1a10d_0    conda-forge
grpc-cpp                  1.47.1               h503f348_6    conda-forge
h11                       0.12.0             pyhd8ed1ab_0    conda-forge
h2                        4.1.0              pyhd8ed1ab_0    conda-forge
hnswlib                   0.6.2                    pypi_0    pypi
hpack                     4.0.0              pyh9f0ad1d_0    conda-forge
html5lib                  1.1                pyh9f0ad1d_0    conda-forge
httpcore                  0.15.0             pyhd8ed1ab_0    conda-forge
httpx                     0.23.0           py39h2804cbe_1    conda-forge
huggingface_hub           0.10.0             pyhd8ed1ab_0    conda-forge
humanfriendly             10.0                     pypi_0    pypi
hyperframe                6.0.1              pyhd8ed1ab_0    conda-forge
icu                       70.1                 h6b3803e_0    conda-forge
idna                      3.4                pyhd8ed1ab_0    conda-forge
imagehash                 4.3.1                    pypi_0    pypi
importlib-metadata        4.11.4           py39h2804cbe_0    conda-forge
importlib_metadata        4.11.4               hd8ed1ab_0    conda-forge
importlib_resources       5.9.0              pyhd8ed1ab_0    conda-forge
ipykernel                 6.16.0             pyh736e0ef_0    conda-forge
ipython                   8.5.0              pyhd1c38e8_1    conda-forge
ipywidgets                8.0.2              pyhd8ed1ab_1    conda-forge
jaraco.classes            3.2.2              pyhd8ed1ab_0    conda-forge
jedi                      0.18.1             pyhd8ed1ab_2    conda-forge
jinja2                    3.1.2              pyhd8ed1ab_1    conda-forge
jmespath                  1.0.1              pyhd8ed1ab_0    conda-forge
joblib                    1.2.0              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   he4db4b2_2    conda-forge
jsonschema                4.16.0             pyhd8ed1ab_0    conda-forge
jupyter_client            7.3.5              pyhd8ed1ab_0    conda-forge
jupyter_core              4.11.1           py39h2804cbe_0    conda-forge
jupyterlab_widgets        3.0.3              pyhd8ed1ab_0    conda-forge
keyring                   23.9.3           py39h2804cbe_0    conda-forge
krb5                      1.19.3               hf9b2bbe_0    conda-forge
lame                      3.100             h1a8c8d9_1002    conda-forge
lcms2                     2.12                 had6a04f_0    conda-forge
lerc                      4.0.0                h9a09cb3_0    conda-forge
libabseil                 20220623.0      cxx17_h28b99d4_4    conda-forge
libarchive                3.5.2                h69ec738_3    conda-forge
libblas                   3.9.0           16_osxarm64_openblas    conda-forge
libbrotlicommon           1.0.9                h1c322ee_7    conda-forge
libbrotlidec              1.0.9                h1c322ee_7    conda-forge
libbrotlienc              1.0.9                h1c322ee_7    conda-forge
libcblas                  3.9.0           16_osxarm64_openblas    conda-forge
libcrc32c                 1.1.2                hbdafb3b_0    conda-forge
libcurl                   7.83.1               h2fcd78c_0    conda-forge
libcxx                    14.0.6               h2692d47_0    conda-forge
libdeflate                1.14                 h1a8c8d9_0    conda-forge
libedit                   3.1.20191231         hc8eb9b7_2    conda-forge
libev                     4.33                 h642e427_1    conda-forge
libevent                  2.1.10               hbae9a57_4    conda-forge
libffi                    3.4.2                h3422bc3_5    conda-forge
libgfortran               5.0.0           11_3_0_hd922786_25    conda-forge
libgfortran5              11.3.0              hdaf2cc0_25    conda-forge
libgoogle-cloud           2.2.0                hf64735a_1    conda-forge
libiconv                  1.17                 he4db4b2_0    conda-forge
libidn2                   2.3.3                he4db4b2_0    conda-forge
liblapack                 3.9.0           16_osxarm64_openblas    conda-forge
libmamba                  0.26.0               h0745fb2_0    conda-forge
libmambapy                0.26.0           py39hd1b7750_0    conda-forge
libnghttp2                1.47.0               h232270b_1    conda-forge
libopenblas               0.3.21          openmp_hc731615_3    conda-forge
libpng                    1.6.38               h76d750c_0    conda-forge
libprotobuf               3.21.7               hb5ab8b9_0    conda-forge
libsodium                 1.0.18               h27ca646_1    conda-forge
libsolv                   0.7.22               h1280f1d_0    conda-forge
libsqlite                 3.39.3               h76d750c_0    conda-forge
libssh2                   1.10.0               hb80f160_3    conda-forge
libtasn1                  4.19.0               h1a8c8d9_0    conda-forge
libthrift                 0.16.0               h1a74c4f_2    conda-forge
libtiff                   4.4.0                hfa0b094_4    conda-forge
libunistring              0.9.10               h3422bc3_0    conda-forge
libutf8proc               2.7.0                h3422bc3_0    conda-forge
libvpx                    1.11.0               hc470f4d_3    conda-forge
libwebp-base              1.2.4                h57fd34a_0    conda-forge
libxcb                    1.13              h9b22ae9_1004    conda-forge
libxml2                   2.10.2               ha9542bf_1    conda-forge
libzlib                   1.2.12               h03a7124_3    conda-forge
llvm-openmp               14.0.4               hd125106_0    conda-forge
lockfile                  0.12.2                     py_1    conda-forge
lz4                       4.0.2                    pypi_0    pypi
lz4-c                     1.9.3                hbdafb3b_1    conda-forge
lzo                       2.10              h642e427_1000    conda-forge
mamba                     0.26.0           py39hde45b87_0    conda-forge
markupsafe                2.1.1            py39hb18efdd_1    conda-forge
matplotlib-inline         0.1.6              pyhd8ed1ab_0    conda-forge
more-itertools            8.14.0             pyhd8ed1ab_0    conda-forge
mpmath                    1.2.1                    pypi_0    pypi
msgpack-python            1.0.4            py39hab5e169_0    conda-forge
multidict                 6.0.2            py39hb18efdd_1    conda-forge
multiprocess              0.70.13          py39h9eb174b_1    conda-forge
mypy_extensions           0.4.3            py39h2804cbe_5    conda-forge
nbformat                  5.6.1              pyhd8ed1ab_0    conda-forge
ncurses                   6.3                  h07bb92c_1    conda-forge
nest-asyncio              1.5.6              pyhd8ed1ab_0    conda-forge
nettle                    3.8.1                h63371fa_1    conda-forge
networkx                  2.8.7                    pypi_0    pypi
nltk                      3.6.7              pyhd8ed1ab_0    conda-forge
numpy                     1.23.3           py39hcb4b507_0    conda-forge
onnx                      1.12.0                   pypi_0    pypi
onnxconverter-common      1.12.2                   pypi_0    pypi
onnxmltools               1.11.1                   pypi_0    pypi
onnxruntime               1.12.1                   pypi_0    pypi
openh264                  2.3.0                h9a09cb3_0    conda-forge
openjpeg                  2.5.0                h5d4e404_1    conda-forge
openpyxl                  3.0.10                   pypi_0    pypi
openssl                   1.1.1q               ha287fd2_0    conda-forge
orc                       1.7.6                hef0d403_1    conda-forge
p11-kit                   0.24.1               h29577a5_0    conda-forge
packaging                 20.9               pyh44b312d_0    conda-forge
pandas                    1.5.0            py39hde7b980_0    conda-forge
parquet-cpp               1.5.1                         2    conda-forge
parso                     0.8.3              pyhd8ed1ab_0    conda-forge
pastel                    0.2.1              pyhd8ed1ab_0    conda-forge
pathspec                  0.10.1             pyhd8ed1ab_0    conda-forge
pexpect                   4.8.0              pyh9f0ad1d_2    conda-forge
pickleshare               0.7.5                   py_1003    conda-forge
pillow                    9.2.0            py39he45c975_2    conda-forge
pip                       22.2.2             pyhd8ed1ab_0    conda-forge
pkginfo                   1.8.3              pyhd8ed1ab_0    conda-forge
pkgutil-resolve-name      1.3.10             pyhd8ed1ab_0    conda-forge
platformdirs              2.5.2              pyhd8ed1ab_1    conda-forge
poetry                    1.1.15           py39h2804cbe_0    conda-forge
poetry-core               1.0.8            py39h2804cbe_1    conda-forge
polars                    0.14.13          py39hc647d1a_0    conda-forge
prompt-toolkit            3.0.31             pyha770c72_0    conda-forge
protobuf                  3.20.1                   pypi_0    pypi
psutil                    5.9.2            py39h02fc5c5_0    conda-forge
pthread-stubs             0.4               h27ca646_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
pure_eval                 0.2.2              pyhd8ed1ab_0    conda-forge
pyarrow                   9.0.0           py39h6e2a28c_6_cpu    conda-forge
pybind11                  2.10.0                   pypi_0    pypi
pybind11-abi              4                    hd8ed1ab_3    conda-forge
pycosat                   0.6.3           py39hb18efdd_1010    conda-forge
pycparser                 2.21               pyhd8ed1ab_0    conda-forge
pydantic                  1.10.2           py39h02fc5c5_0    conda-forge
pygments                  2.13.0             pyhd8ed1ab_0    conda-forge
pylev                     1.4.0              pyhd8ed1ab_0    conda-forge
pymagnitude-lite          0.1.143                  pypi_0    pypi
pyopenssl                 22.0.0             pyhd8ed1ab_1    conda-forge
pyparsing                 3.0.9              pyhd8ed1ab_0    conda-forge
pyrsistent                0.18.1           py39hb18efdd_1    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
python                    3.9.13          hc596b02_0_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python-dotenv             0.21.0             pyhd8ed1ab_0    conda-forge
python-fastjsonschema     2.16.2             pyhd8ed1ab_0    conda-forge
python-louvain            0.16                     pypi_0    pypi
python_abi                3.9                      2_cp39    conda-forge
pytorch                   1.12.1                  py3.9_0    pytorch
pytz                      2022.2.1           pyhd8ed1ab_0    conda-forge
pywavelets                1.4.1                    pypi_0    pypi
pyyaml                    6.0              py39hb18efdd_4    conda-forge
pyzmq                     24.0.1           py39h0553236_0    conda-forge
re2                       2022.06.01           h9a09cb3_0    conda-forge
readline                  8.1.2                h46ed386_0    conda-forge
regex                     2022.9.13        py39h02fc5c5_0    conda-forge
reproc                    14.2.3               h3422bc3_0    conda-forge
reproc-cpp                14.2.3               hbdafb3b_0    conda-forge
requests                  2.28.1             pyhd8ed1ab_1    conda-forge
requests-toolbelt         0.9.1                      py_0    conda-forge
responses                 0.18.0             pyhd8ed1ab_0    conda-forge
rfc3986                   1.5.0              pyhd8ed1ab_0    conda-forge
rich                      12.6.0                   pypi_0    pypi
ruamel.yaml               0.17.21          py39hb18efdd_1    conda-forge
ruamel.yaml.clib          0.2.6            py39hb18efdd_1    conda-forge
ruamel_yaml               0.15.80         py39h9eb174b_1007    conda-forge
s3transfer                0.6.0              pyhd8ed1ab_0    conda-forge
sacremoses                0.0.53             pyhd8ed1ab_0    conda-forge
scikit-learn              1.1.1                    pypi_0    pypi
scipy                     1.9.1            py39h737da60_0    conda-forge
sentence-transformers     2.2.2              pyhd8ed1ab_0    conda-forge
sentencepiece             0.1.96           py39h2c803a9_1    conda-forge
setuptools                65.4.0             pyhd8ed1ab_0    conda-forge
shellingham               1.5.0              pyhd8ed1ab_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
skl2onnx                  1.13                     pypi_0    pypi
snappy                    1.1.9                h39c3846_1    conda-forge
sniffio                   1.3.0              pyhd8ed1ab_0    conda-forge
soundfile                 0.11.0                   pypi_0    pypi
soupsieve                 2.3.2.post1              pypi_0    pypi
sqlite                    3.39.3               h2229b38_0    conda-forge
stack_data                0.5.1              pyhd8ed1ab_0    conda-forge
starlette                 0.20.4                   pypi_0    pypi
svt-av1                   1.2.1                he23bcac_0    conda-forge
sympy                     1.11.1                   pypi_0    pypi
threadpoolctl             3.1.0              pyh8a188c0_0    conda-forge
tika                      1.24                     pypi_0    pypi
timm                      0.6.7                    pypi_0    pypi
tk                        8.6.12               he1e0b03_0    conda-forge
tokenizers                0.12.1           py39hae86270_1    conda-forge
toml                      0.10.2             pyhd8ed1ab_0    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
tomlkit                   0.11.5             pyha770c72_0    conda-forge
toolz                     0.12.0             pyhd8ed1ab_0    conda-forge
torchvision               0.13.1                 py39_cpu    pytorch
tornado                   6.2              py39h9eb174b_0    conda-forge
tqdm                      4.64.1             pyhd8ed1ab_0    conda-forge
traitlets                 5.4.0              pyhd8ed1ab_0    conda-forge
transformers              4.22.2             pyhd8ed1ab_0    conda-forge
txtai                     5.0.0                    pypi_0    pypi
typed-ast                 1.5.4            py39h9eb174b_0    conda-forge
typing                    3.10.0.0           pyhd8ed1ab_0    conda-forge
typing-extensions         4.3.0                hd8ed1ab_0    conda-forge
typing_extensions         4.3.0              pyha770c72_0    conda-forge
tzdata                    2022d                h191b570_0    conda-forge
urllib3                   1.26.11            pyhd8ed1ab_0    conda-forge
uvicorn                   0.18.3                   pypi_0    pypi
virtualenv                20.16.5          py39h2804cbe_0    conda-forge
wcwidth                   0.2.5              pyh9f0ad1d_2    conda-forge
webencodings              0.5.1                      py_1    conda-forge
wheel                     0.37.1             pyhd8ed1ab_0    conda-forge
widgetsnbextension        4.0.3              pyhd8ed1ab_0    conda-forge
x264                      1!164.3095           h57fd34a_2    conda-forge
x265                      3.5                  hbc6ce65_3    conda-forge
xmltodict                 0.13.0                   pypi_0    pypi
xorg-libxau               1.0.9                h27ca646_0    conda-forge
xorg-libxdmcp             1.1.3                h27ca646_0    conda-forge
xxhash                    3.0.0                    pypi_0    pypi
xz                        5.2.6                h57fd34a_0    conda-forge
yaml                      0.2.5                h3422bc3_2    conda-forge
yaml-cpp                  0.7.0                hb7217d7_2    conda-forge
yarl                      1.7.2            py39hb18efdd_2    conda-forge
zeromq                    4.3.4                hbdafb3b_1    conda-forge
zipp                      3.8.1              pyhd8ed1ab_0    conda-forge
zlib                      1.2.12               h03a7124_3    conda-forge
zstd                      1.5.2                h8128057_4    conda-forge

I'm happy to provide further information if needed.

laurids-reichardt commented 1 year ago

Just confirmed that the example above runs fine on linux amd64 hardware with cuda support.

davidmezzetti commented 1 year ago

Thanks for giving txtai a try and taking the time to submit an issue!

Couple ideas:

  1. Try downgrading pytorch to 1.11. pytorch==1.12.x has had segfault issues on macOS. 

    pip install torch==1.11.0 torchvision==0.12.0

  2. Try using a different index backend. While Faiss is supported on Apple Silicon, I'm not sure how well supported it is.

    embeddings = Embeddings({"path": "sentence-transformers/nli-mpnet-base-v2", "backend": "hnsw"})

Unfortunately, I don't use Apple hardware, so it would be tough for me to debug/reproduce. txtai does have GitHub actions for macOS but it's x86-64 based. There is a long standing issue to add Apple Silicon support to GitHub Actions but it looks like it's currently unresolved.

laurids-reichardt commented 1 year ago

Hi @davidmezzetti, thank you for developing and publishing this great library!

Indeed, changing the backend to hnsw worked out. Thanks for the tip!

Yes, unfortunately many ML libraries only partially support macOS and/or arm64. In most cases bigger experiments or production workloads will run on Linux with CUDA anyway, but it's always nice to be able to try out libraries on local hardware first. Great to see that it's possible to run txtai on Apple hardware!

davidmezzetti commented 1 year ago

Glad to hear it!

romainr commented 1 year ago

👍

FWIW did the pip from https://github.com/neuml/txtai/issues/350#issuecomment-1264773406 withpip install txtai[similarity] and it seem to work now even without hnsw backend