ERROR: Could not build wheels for faiss-cpu, which is required to install pyproject.toml-based projects in linux Alpine

[pfcstyle]

Describe the bug Can't build wheels.

To Reproduce

pip install faiss-cpu

Expected behavior

#11 827.7       swigging faiss/faiss/python/swigfaiss.i to faiss/faiss/python/swigfaiss_wrap.cpp
#11 827.7       swig -python -c++ -Doverride= -I/usr/local/include -Ifaiss -doxygen -DSWIGWORDSIZE64 -module swigfaiss -o faiss/faiss/python/swigfaiss_wrap.cpp faiss/faiss/python/swigfaiss.i
#11 827.7       faiss/faiss/python/swigfaiss.i:268: Error: Unable to find 'faiss/impl/platform_macros.h'
#11 827.7       faiss/faiss/python/swigfaiss.i:272: Error: Unable to find 'faiss/utils/ordered_key_value.h'
#11 827.7       faiss/faiss/python/swigfaiss.i:273: Error: Unable to find 'faiss/utils/Heap.h'
#11 827.7       faiss/faiss/python/swigfaiss.i:278: Error: Unable to find 'faiss/utils/AlignedTable.h'

...

#11 827.7       [end of output]
#11 827.7   
#11 827.7   note: This error originates from a subprocess, and is likely not a problem with pip.
#11 827.7   ERROR: Failed building wheel for faiss-cpu
#11 827.7 Successfully built numexpr numpy PyYAML
#11 827.7 Failed to build faiss-cpu
#11 827.7 ERROR: Could not build wheels for faiss-cpu, which is required to install pyproject.toml-based projects

Desktop (please complete the following information):

• OS: Alpine
• Architecture: x86_64
• Python: 3.10.12
• Version: v1.7.4
• swig: 4.1.1
• pip: 23.2.1(latest)

[kyamagu]

Likely an issue with swig version compatibility

[pfcstyle]

I downgraded swig version to 4.0.2, the error is same.

#12 [python 2/4] RUN echo "swig path" &&   which swig &&   echo "swig version" &&   swig -version
#12 0.493 swig path
#12 0.497 /usr/bin/swig
#12 0.498 swig version
#12 0.704 
#12 0.704 SWIG Version 4.0.2

#14 871.4       building 'faiss._swigfaiss' extension
#14 871.4       swigging faiss/faiss/python/swigfaiss.i to faiss/faiss/python/swigfaiss_wrap.cpp
#14 871.4       swig -python -c++ -Doverride= -I/usr/local/include -Ifaiss -doxygen -DSWIGWORDSIZE64 -module swigfaiss -o faiss/faiss/python/swigfaiss_wrap.cpp faiss/faiss/python/swigfaiss.i
#14 871.4       faiss/faiss/python/swigfaiss.i:268: Error: Unable to find 'faiss/impl/platform_macros.h'
#14 871.4       faiss/faiss/python/swigfaiss.i:272: Error: Unable to find 'faiss/utils/ordered_key_value.h'
#14 871.4       faiss/faiss/python/swigfaiss.i:273: Error: Unable to find 'faiss/utils/Heap.h'
#14 871.4       faiss/faiss/python/swigfaiss.i:278: Error: Unable to find 'faiss/utils/AlignedTable.h'
#14 871.4       faiss/faiss/python/swigfaiss.i:279: Error: Unable to find 'faiss/utils/partitioning.h'
#14 871.4       faiss/faiss/python/swigfaiss.i:280: Error: Unable to find 'faiss/utils/hamming.h'
#14 871.4       faiss/faiss/python/swigfaiss.i:281: Error: Unable to find 'faiss/utils/hamming_distance/common.h'
...
#14 871.4       faiss/faiss/python/swigfaiss.i:760: Error: Unable to find 'faiss/MatrixStats.h'
#14 871.4       error: command '/usr/bin/swig' failed with exit code 1
#14 871.4       [end of output]
#14 871.4   
#14 871.4   note: This error originates from a subprocess, and is likely not a problem with pip.
#14 871.4   ERROR: Failed building wheel for faiss-cpu
#14 871.4 Successfully built numexpr numpy PyYAML
#14 871.4 Failed to build faiss-cpu
#14 871.4 ERROR: Could not build wheels for faiss-cpu, which is required to install pyproject.toml-based projects

[pfcstyle]

Tried: python:3.9.17, swig:4.0.2, faiss-cpu:1.7.2, python:3.8.15, swig:4.0.2, faiss-cpu:1.7.4, same error, no lucky

[pfcstyle]

python:3.10.12, swig:3.0.12-r4, faiss-cpu:1.7.4, still failed, looks like swig=3.0.12 is too low.

#14 [python 4/4] RUN pip3 install faiss-cpu==1.7.4
#14 1.286 Collecting faiss-cpu==1.7.4
#14 1.384   Downloading faiss-cpu-1.7.4.tar.gz (57 kB)
#14 1.416      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.4/57.4 kB 1.9 MB/s eta 0:00:00
#14 1.500   Installing build dependencies: started
#14 76.89   Installing build dependencies: still running...
#14 179.7   Installing build dependencies: still running...
#14 243.0   Installing build dependencies: still running...
#14 312.8   Installing build dependencies: still running...
#14 373.2   Installing build dependencies: still running...
#14 384.8   Installing build dependencies: finished with status 'done'
#14 384.8   Getting requirements to build wheel: started
#14 385.1   Getting requirements to build wheel: finished with status 'done'
#14 385.1   Preparing metadata (pyproject.toml): started
#14 385.5   Preparing metadata (pyproject.toml): finished with status 'done'
#14 385.5 Building wheels for collected packages: faiss-cpu
#14 385.5   Building wheel for faiss-cpu (pyproject.toml): started
#14 385.9   Building wheel for faiss-cpu (pyproject.toml): finished with status 'error'
#14 385.9   error: subprocess-exited-with-error
#14 385.9   
#14 385.9   × Building wheel for faiss-cpu (pyproject.toml) did not run successfully.
#14 385.9   │ exit code: 1
#14 385.9   ╰─> [10 lines of output]
#14 385.9       running bdist_wheel
#14 385.9       running build
#14 385.9       running build_py
#14 385.9       running build_ext
#14 385.9       building 'faiss._swigfaiss' extension
#14 385.9       swigging faiss/faiss/python/swigfaiss.i to faiss/faiss/python/swigfaiss_wrap.cpp
#14 385.9       swig -python -c++ -Doverride= -I/usr/local/include -Ifaiss -doxygen -DSWIGWORDSIZE64 -module swigfaiss -o faiss/faiss/python/swigfaiss_wrap.cpp faiss/faiss/python/swigfaiss.i
#14 385.9       swig error : Unrecognized option -doxygen
#14 385.9       Use 'swig -help' for available options.
#14 385.9       error: command '/usr/bin/swig' failed with exit code 1
#14 385.9       [end of output]
#14 385.9   
#14 385.9   note: This error originates from a subprocess, and is likely not a problem with pip.
#14 385.9   ERROR: Failed building wheel for faiss-cpu
#14 385.9 Failed to build faiss-cpu
#14 385.9 ERROR: Could not build wheels for faiss-cpu, which is required to install pyproject.toml-based projects

[kyamagu]

Ok, then did you already install faiss in the system? The faiss itself must be already available to build a wrapper.

[pfcstyle]

Looks can't build faiss on alpine https://github.com/facebookresearch/faiss/issues/468

I changed my docker image to ubuntu, it works.