feat: support struct_pack function if duckdb enabled

voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).

Apache License 2.0

15 stars 8 forks source link

feat: support struct_pack function if duckdb enabled #68

Open pat70 opened 1 month ago

pat70 commented 1 month ago

Enables unresolved_function mappings for

struct_pack as shown below:

(get_customer_database(spark_session)
.select(struct(col('c_custkey'), col('c_name')).alias('test_struct'))
.show())

and struct_extract as shown below:

(get_customer_database(spark_session)
.select(struct(col('c_custkey'), col('c_name')).alias('test_struct'))
.select(col('test_struct').getField('c_name'))
.show())

fixes #67

github-actions[bot] commented 1 month ago

ACTION NEEDED

Substrait follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.