voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
16 stars 9 forks source link

feat: add support for AddArtifacts #22

Closed EpsilonPrime closed 5 months ago

EpsilonPrime commented 5 months ago

This has been manually tested with spark-connect-repl. Automated testing would be nice but we don't have a way to have it triggered from pyspark. The best we could do would be testing the RPC directly.

github-actions[bot] commented 5 months ago

ACTION NEEDED

Substrait follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.