search

voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
15 stars 8 forks source link

feat: add tpcds queries and spark tests #62

Closed richtia closed 1 month ago

richtia commented 1 month ago

Queries have been taken from the ibis project: https://github.com/ibis-project/ibis/tree/main/ibis/backends/tests/tpc/queries/duckdb/ds

Some queries have been modified to use backticks in the aliases instead of quotes in order to work with spark sql.

Only 3 queries are able to run on duckdb currently. I've added markers to the other queries for now and will fix them in subsequent PRs.

github-actions[bot] commented 1 month ago

ACTION NEEDED

Substrait follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.