voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
15 stars 8 forks source link

feat: support for file data source read options #63

Closed richtia closed 1 month ago

richtia commented 1 month ago

Add support for DataFrameReader options to specify read path as a key, value pair

Closes https://github.com/voltrondata/spark-substrait-gateway/issues/56