apache / datafusion-python

Apache DataFusion Python Bindings
https://datafusion.apache.org/python
Apache License 2.0
323 stars 64 forks source link

Substrait Rust Feature #526

Closed jdye64 closed 8 months ago

jdye64 commented 8 months ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do. While currently it is possible to use the protoc feature in ADP that simply attempts to compile protobuf-src and use the resulting binary to compile the protobuf definition files needed by the substrait module. However, in certain conda environments there are situations where the appropriate system libraries are not available for protobuf-src to successfully compile. Therefore I think it makes sense to make a substrait feature that would make the substrait module optional for these cases.

Describe the solution you'd like Add a new substrait feature to Cargo.toml which when specified would compile the substrait module. Default would be to not include the substrait module.

Describe alternatives you've considered None

Additional context None