facebookresearch / faiss

A library for efficient similarity search and clustering of dense vectors.
https://faiss.ai
MIT License
31.63k stars 3.65k forks source link

Will Faiss appear on PyPI in the light of the recent news? #4030

Closed Yura52 closed 1 week ago

Yura52 commented 1 week ago

The PyTorch team will soon stop publishing packages to Conda: https://github.com/pytorch/pytorch/issues/138506

I wonder if the Faiss team is planning something similar. In particular, I wonder if the following technical context can make the PyPI story more accessible for Faiss and its users than before.

(1) NVIDIA now publishes its packages on PyPI, and my understanding is that PyTorch already relies on that.

(2) uv is becoming increasingly popular in the Python community, and it provides an easy way to specify custom PyPI index for specific packages in pyproject.toml, if, for whatever reason, the default index is not suitable for a given package. For example:

# pyproject.toml

[project]
...
dependencies = [
    ...,
    "torch ==2.0.1",
]

[tool.uv.sources]
torch = { index = "pytorch" }

[[tool.uv.index]]
name = "pytorch"
url = "https://download.pytorch.org/whl/cu118"
explicit = true

[[tool.uv.index]]
url = "https://pypi.org/simple"
default = true
junjieqi commented 1 week ago

@Yura52 it is definitely on our radar. We also discussed it internally as well. Will keep updated in the community. cc @asadoughi

asadoughi commented 1 week ago

Closing as duplicate of #3152