chore: skip closed streams in flush tick. Log when flushing due to time wind…

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

https://airbyte.com

Other

16.27k stars 4.15k forks source link

chore: skip closed streams in flush tick. Log when flushing due to time wind… #48605

Closed tryangul closed 2 days ago

tryangul commented 2 days ago

What

Checks if queue (channel) is closed before sending tick tasks Adds log for visibility on time window trigger

How

Adds a check in the loop for closed channels
Handles exceptions due to any race
Creates MessageQueue#isClosedForPublish for checking underlying channel
Log line

vercel[bot] commented 2 days ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment