kaskada-ai / kaskada

Modern, open-source event-processing
https://kaskada.io/
Apache License 2.0
348 stars 15 forks source link

Partitioned Scheduling: Investigate Race Conditions #842

Open jordanrfrazier opened 10 months ago

jordanrfrazier commented 10 months ago

Partitioned scheduling uses a ScheduleCount to keep track of whether tasks need to be scheduled / re-scheduled. However, there may exist race conditions where the pipeline itself needs to re-schedule the task when the input queue is non-empty.

This issue serves as a reminder/spike task to