search

intel / scikit-learn-intelex

Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
https://intel.github.io/scikit-learn-intelex/
Apache License 2.0
1.18k stars 171 forks source link

pypy3 support for daal4py/sklearnex #1580

Open lukezli opened 7 months ago

lukezli commented 7 months ago

Describe the bug Hi all, thank you very much for such a great project! I am using pypy3 to speed up some python ML processes, but I'd like to use daal4py to speed up inference and it doesn't seem supported. Is there any way to patch it or to build from scratch to be compatible with pypy? Installing via python3 -m pip works fine.

To Reproduce pypy3 -m pip install daal4py

import daal4py

Expected behavior Should ideally work

Output/Screenshots

image

Environment: Ubuntu 22.04, daal==2024.0.0

Alexsandruss commented 7 months ago

Support of pypy interpreter is not implemented currently.

lukezli commented 7 months ago

Thanks for your response! Do you have any suggestions on how I can interface with daal4py via pypy3? Whether it be via writing some code to interface with the c library directly or something else? I tried creating a rpc interface from pypy to regular cpython but the overhead transmitting the data was too slow unfortunately.