faiss not functioning correctly

[sdake]

Unfortunately, building faiss has been a major challenge.

There are several problems:

• cuda 12.2.2 not used
• setup.py during wheel generation does not include python callbacks shared object
• ld.so cache config files are not created for faiss or mkl
• intel mkl is not exported as a tarball
• faiss is not exported as a tarball.

The net result is that when having to do anything new, faiss must be rebuilt, for the 150th time.

Whisky tango foxtrot.

[sdake]

Related issue: https://github.com/facebookresearch/faiss/pull/2062

[sdake]

Root cause: https://github.com/facebookresearch/faiss/issues/2063#issuecomment-925952432

[sdake]

I came across this Dockerfile which has been removed in main. This is nice in that it doesn't include a boatload of dependencies, as in its a good reference. https://github.com/facebookresearch/faiss/blob/1.7.3_release/Dockerfile

[sdake]

This is interesting: https://www.intel.com/content/www/us/en/developer/tools/oneapi/onemkl-link-line-advisor.html#gs.6zoiw9

[sdake]

Intel Math Kernel Library Linking considerations.