sjrusso8 / spark-connect-rs

Apache Spark Connect Client for Rust

https://docs.rs/spark-connect-rs

Apache License 2.0

52 stars 11 forks source link

feat(dataframe): Spark DF to Polars, DataFusion, or JSON #43

Closed sjrusso8 closed 1 month ago

sjrusso8 commented 1 month ago

Description

feat(dataframe): Spark DF to Polars, DataFusion, or JSON

from a spark dataframe create a polars DataFrame
from a spark dataframe create a datafusion DataFrame
from a spark dataframe create a JSON string with toJSON