search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.29k stars 4.15k forks source link

Source Amazon Seller Partner: Reports schema "Does not match the date-time pattern must be a valid RFC 3339 date-time" #45589

Open linuxs opened 2 months ago

linuxs commented 2 months ago

Connector Name

source-amazon-seller-partner

Connector Version

4.4.1

What step the error happened?

During the sync

Relevant information

We're pulling in custom reports in the OSS version of Airbyte. One issue we're experiencing occurs during syncing of 'GET_VENDOR_SALES_REPORT' the start and end dates do not conform to RFC 3339 date-time standards.

The schema provided by Amazon also indicates this: https://github.com/amzn/selling-partner-api-models/blob/main/schemas/reports/vendorSalesReport.json

Relevant log output

Schema validation errors found for stream _GET_VENDOR_SALES_REPORT. Error messages: [$.startDate: does not match the date-time pattern must be a valid RFC 3339 date-time, $.endDate: does not match the date-time pattern must be a valid RFC 3339 date-time]
2024-09-15 15:54:16 replication-orchestrator > Source 35b8723e-4a45-46cf-899c-89dd9972210a has unexpected fields [queryEndDate, dataEndTime] in stream _GET_VENDOR_SALES_REPORT

Contribute

marcosmarxm commented 2 months ago

Thanks for reporting the issue @linuxs can you share the complete sync log? Is this happening only to _GET_VENDOR_SALES_REPORT?