search

kaskada-ai / kaskada

Modern, open-source event-processing
https://kaskada.io/
Apache License 2.0
351 stars 15 forks source link

Filter periodically (with ticks) #759

Closed jordanrfrazier closed 1 year ago

jordanrfrazier commented 1 year ago

We want to support filtering on predicates (or ticks). The plan is to

  1. Expose a new python window type that is rewritten to use when in sparrow -- this allows for windowed_agg | when(..) without exposing ticks to timestreams
  2. Build up aggregations with the new design when swapping over to partitioned execution codebase