search

delta-io / delta-sharing

An open protocol for secure data sharing
https://delta.io/sharing
Apache License 2.0
745 stars 168 forks source link

No module named 'delta_kernel_rust_sharing_wrapper' on delta-sharing 1.1.0 #552

Open championj-db opened 1 month ago

championj-db commented 1 month ago

Issue After pip install delta-sharing I cannot run an import delta_sharing command as I receive this error: ModuleNotFoundError: No module named 'delta_kernel_rust_sharing_wrapper'

Reverting back to 1.0.5 with pip install delta-sharing==1.0.5 appears to resolve this issue, As does doing a pip install delta-kernel-rust-sharing-wrapper

Expectation Doing a pip install delta-sharing on the latest version should be able to pull in required dependencies

Context I am trying to run the delta-sharing-airlines demo https://www.databricks.com/resources/demos/tutorials/data-sharing/delta-sharing-airlines and encounter this in notebook 03-receiver-delta-sharing-demo using the generated cluster (DBR 12.2 LTS ML, Spark 3.3.2, Scala 2.12)

forzagreen commented 1 month ago

As explained in the release notes of v1.1.0, section Important Installation Notes, you must install delta-kernel-rust-sharing-wrapper

I agree that it would be better if delta-kernel-rust-sharing-wrapper were a dependancy of delta-sharing.

GBBBAS commented 1 month ago

As explained in the release notes of v1.1.0, section Important Installation Notes, you must install delta-kernel-rust-sharing-wrapper

I agree that it would be better if delta-kernel-rust-sharing-wrapper were a dependancy of delta-sharing.

Can we expect that it is it planned to be added as a dependency in a next release?