search

oracle / graalpython

GraalPy – A high-performance embeddable Python 3 runtime for Java
https://www.graalvm.org/python/
Other
1.25k stars 111 forks source link

GraalPy doesn't work with spaCy NLP #450

Open kevintanhongann opened 2 weeks ago

kevintanhongann commented 2 weeks ago

GraalPy doesn't work with spaCy libraries because spaCy uses native extensions. Python binary wheels don't exist for spaCy yet.

GboX5l7bcAAPQK7

fniephaus commented 2 weeks ago

Thanks for reporting this, @kevintanhongann.

spaCy not only uses native extensions itself, it also depends on numpy and numerous other Python packages that also use native extensions. Building all of this from source can easily take over an hour on a standard developer machine, which probably explains why the build process is not done on your machine after 12min.

An early experiment on our end shows that spaCy can be built from source for GraalPy, and that a bunch of tests are passing already. However, there are also some segfaults that need to be addressed before it makes sense to look into distributing binary wheels for all of this.