sjrusso8 / spark-connect-rs

Apache Spark Connect Client for Rust

https://docs.rs/spark-connect-rs

Apache License 2.0

54 stars 11 forks source link

feat(client/handler): reimplement client & response handlers #9

Closed sjrusso8 closed 3 months ago

sjrusso8 commented 3 months ago

Description

feat(client/handler): reimplement client & response handlers

Rewrote the spark client to so it handles responses and requests. Logic is no longer on the SparkSession
Actions no longer return Vec<RecordBatch> but one RecordBatch
Fixed issue with incorrect de-serialization during the handling of the response
Remove old handler logic
Update tests

Related Issue(s)

closes #7