search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.32k stars 4.16k forks source link

[source-amazon-seller-partner] VendorOrders stream should allow other cursor fields #46308

Open GtheSheep opened 1 month ago

GtheSheep commented 1 month ago

Connector Name

source-amazon-seller-partner

Connector Version

4.4.1

What step the error happened?

None

Relevant information

This endpoint allows filtering by changedBefore/ changedAfter or createdBefore/ createdAfter, currently the source sets it as changedBefore, but this then does not allow pulling recently created orders that are yet to be modified, so although it's a sensible default, being able to select createdBefore as the cursor field would be useful

Relevant log output

No response

Contribute

If someone could point me to an example of a stream that allows (different fields) this for the cursor/ replication start/ end date functionality, I'll be happy to try and contribute

GtheSheep commented 1 month ago

It seems like the only option is to make a potentially breaking change to that stream and remove the default cursor entirely as they can't be overiden if defined on the source? 😬

marcosmarxm commented 2 weeks ago

I've added the issue to the connector backlog, but it won't be prioritized for now. If this issue is affecting you, please comment or give it a 👍. This helps the team understand the number of users facing the same problem so that high-impact issues can be prioritized.