sjrusso8 / spark-connect-rs

Apache Spark Connect Client for Rust
https://docs.rs/spark-connect-rs
Apache License 2.0
52 stars 11 forks source link

feat(window): create Window & WindowSpec #19

Closed sjrusso8 closed 2 months ago

sjrusso8 commented 2 months ago

Description

feat(window): create Window & WindowSpec

Example Usage

let df = spark.createDataFrame(&data)?;

let window = Window::new()
    .partitionBy(col("category"))
    .orderBy([col("id")])
    .rowsBetween(Window::currentRow(), 1);

let df = df
    .withColumn("sum", sum("id").over(window))
    .sort([col("id"), col("category"), col("sum")]);