sjrusso8 / spark-connect-rs

Apache Spark Connect Client for Rust

https://docs.rs/spark-connect-rs

Apache License 2.0

54 stars 11 forks source link

Closed sjrusso8 closed 3 months ago

sjrusso8 commented 3 months ago

Description

feat(dataframe):

implement more basic traits for DataFrame
change interface to leverage Enums where possible (jointype, savemode, storagelevel)
create storage.rs with enum wrapper around spark::StorageLevel
create tests for some of the traits
update docker-compose.yml with delta-spark & add an example of reading a delta table