search

datafusion-contrib / datafusion-python

Python binding for DataFusion
https://arrow.apache.org/datafusion/python/index.html
Apache License 2.0
59 stars 12 forks source link

upgrade datafusion and pyo3 #20

Closed jimexist closed 2 years ago

jimexist commented 2 years ago

need to wait for next release of datafusion

matthewmturner commented 2 years ago

@Jimexist Can I test this by using the instructions in How To Develop section of readme?

matthewmturner commented 2 years ago

I ran tests on this branch and they passed

matthewmturner commented 2 years ago

I'm trying to use this branch to run updated benchmarks for db-benchmark

when i use maturin develop im able to use it locally as expected.

however, when i use maturin develop --release I get the following when trying to import datafusion

Python 3.8.9 (default, Oct 26 2021, 07:25:53)
[Clang 13.0.0 (clang-1300.0.29.30)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import datafusion
Killed: 9

Any thoughts on what could cause this? Im looking into it on my side as well but wanted to raise it here in case anyone was familiar with this.

matthewmturner commented 2 years ago

When I build the wheels with maturin build --release and install the wheel file directly it works. I guess you can ignore the above.

jimexist commented 2 years ago

i sometimes will run into kill 9 by OS on my Mac - not sure if it's related but it's not persistent