search

oracle / graalpython

GraalPy – A high-performance embeddable Python 3 runtime for Java
https://www.graalvm.org/python/
Other
1.24k stars 108 forks source link

GraalPy doesn't work with spaCy NLP #450

Open kevintanhongann opened 2 days ago

kevintanhongann commented 2 days ago

GraalPy doesn't work with spaCy libraries because spaCy uses native extensions. Python binary wheels don't exist for spaCy yet.

GboX5l7bcAAPQK7

fniephaus commented 2 days ago

Thanks for reporting this, @kevintanhongann.

spaCy not only uses native extensions itself, it also depends on numpy and numerous other Python packages that also use native extensions. Building all of this from source can easily take over an hour on a standard developer machine, which probably explains why the build process is not done on your machine after 12min.

An early experiment on our end shows that spaCy can be built from source for GraalPy, and that a bunch of tests are passing already. However, there are also some segfaults that need to be addressed before it makes sense to look into distributing binary wheels for all of this.