search

sjrusso8 / spark-connect-rs

Apache Spark Connect Client for Rust
https://docs.rs/spark-connect-rs
Apache License 2.0
76 stars 13 forks source link

Epic: Spark 4.0 Connect Spec #61

Open sjrusso8 opened 3 months ago

sjrusso8 commented 3 months ago

Description

Spark 4.0 implements changes to the connect proto. We will to analyze the spec and identify what has changed.

Additionally, we will need to support both a client for Spark 3.5 and Spark 4.0. There should be a feature flag on the client for 3_5 or 4_0