search

DataSQRL / sqrl

Flexible development framework for building streaming data applications in SQL with Kafka, Flink, Postgres, GraphQL, and more.
https://www.datasqrl.com/
97 stars 14 forks source link

Json Array Aggregation merging doesn't handle retractions #821

Open mbroecheler opened 1 month ago

mbroecheler commented 1 month ago

causing duplications when merging.

Compare to the listagg implementation which keeps tracks of retractions separately and removes them during merging: https://github.com/apache/flink/blob/20e9826f7701f91eedfbf599afb33822128145e6/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/functions/aggregate/ArrayAggFunction.java

henneberger commented 1 month ago

I'll experiment with removing the merge function