pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
https://pathway.com
Other
4.34k stars 139 forks source link

Add `first_value`/`last_value` reducers. #40

Closed izulin closed 7 months ago

izulin commented 7 months ago

Is your feature request related to a problem? Please describe.

Add a reducer that keeps the first/last system_time value.

dxtrous commented 7 months ago

Thanks - this is a partial duplicate of #18 ?

izulin commented 7 months ago

Thanks - this is a partial duplicate of #18 ?

not really -- system_time vs data_time (time column)

izulin commented 7 months ago

available in 0.9.0

jagatsingh commented 4 months ago

This will be a great enhancement as it is common use case in time series analytics.

KamilPiechowiak commented 4 months ago

Hey, @jagatsingh, this issue is already completed. We have earliest and latest reducers. They return values with the lowest/highest processing time respectively.