airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.27k stars 4.15k forks source link

feat(source-pipedrive): update cdk to enable concurrency #48615

Open darynaishchenko opened 1 day ago

darynaishchenko commented 1 day ago

What

Migration to one CDK: Streams without partition routers or cursors should run concurrently : Migrate low-risk source connector

How

Updated cdk verion to v6.7.0rc2 (this version has changes to run streams without partition routers and without cursor as concurrent streams). Updated source creation, added num_workers to spec.

Review guide

User Impact

Can this PR be safely reverted and rolled back?

vercel[bot] commented 1 day ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 22, 2024 10:50am