airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.3k stars 4.15k forks source link

[bulk-extract-cdk] skip errors caused by unparseable DDLs #48612

Closed burakku closed 5 days ago

burakku commented 5 days ago

What

This change is to fix debezium bug mentioned in #48497

How

It fixes the problem by setting schema.history.internal.skip.unparseable.ddl in DebeziumProperties to True to skip errors caused by unparseable DDLs

Review guide

Reproduced the problem locally Before the fix:

Screenshot 2024-11-22 at 10 25 15 AM

After fix:

Screenshot 2024-11-22 at 10 23 57 AM

User Impact

None

Can this PR be safely reverted and rolled back?

vercel[bot] commented 5 days ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment | Name | Status | Preview | Comments | Updated (UTC) | | :--- | :----- | :------ | :------- | :------ | | **airbyte-docs** | ⬜️ Ignored ([Inspect](https://vercel.com/airbyte-growth/airbyte-docs/7DQjYs3YSLRVVLGhhhsth1NyAU6E)) | | | Nov 22, 2024 8:14am |
CLAassistant commented 5 days ago

CLA assistant check
All committers have signed the CLA.

theyueli commented 5 days ago

@postamar I see this fix is sent to new cdk, so do we also need to bump up the version of the CDK?