search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.64k stars 4.03k forks source link

Column Selection -- Shopify to S3 #45623

Open my-mai opened 1 week ago

my-mai commented 1 week ago

Connector Name

Shopify

Connector Version

2.4.24

What step the error happened?

Other

Relevant information

Hello,

We're on Airbyte open source.

I have a connection set up for Shopify -> S3 and column selection does not appear to be working when I check the files out on S3.

We're trying to remove fields that contain PII in them. Can confirm this is the case for orders and products schema as they are the only ones I've tried so far. Can see on the far right side that columns have been deselected 86/94.

airbyte_column_selection

Thanks

Relevant log output

No response

Contribute

my-mai commented 1 week ago

tested column selection with mysql as source and it appears to work. Any chance we can get someone from the airbyte team to check if column selection is working properly with Shopify? Thanks