search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.48k stars 3.99k forks source link

[soruce-dynamoDB] breaking with empty tables #43408

Open rogerzs opened 1 month ago

rogerzs commented 1 month ago

Connector Name

dynamodb-source

Connector Version

0.3.6

What step the error happened?

Other

Relevant information

Hi Guys, how are u?

When i try to create a connection between dynamodb source and any destination, but I have an empty table in dynamo, I get the error that the primary key was not found for the stream.

The problem does not allow us to create the connection

I think ignoring empty tables would be a good ideia.

Relevant log output

failed for stream: service-table-test. Error: key: 'pk' of path: '[pk]' not found in schema

Contribute

marcosmarxm commented 1 month ago

Thanks for reporting the issue @rogerzs Dynamodb is a community connector and it isn’t in the current roadmap for improvements. If you want to contribute fixing the issue please reach me out in Slack so I can provide you instructions to make the contribution.