search

singer-io / tap-chargebee

Singer.io tap for extracting data from the Chargebee API
https://www.singer.io/
GNU Affero General Public License v3.0
7 stars 32 forks source link

Endless 'Error persisting data to Stitch: 400' error #43

Open willyhum opened 3 years ago

willyhum commented 3 years ago

Hey everyone

I'm getting this 400 error on all extractions:

Error persisting data to Stitch: 400: {'error': 'Record 130 for table payment_sources did not conform to schema:\n#: #: no subschema matched out of the total 2 subschemas\n#: expected: null, found: JSONObject\n#/reference_id: #: no subschema matched out of the total 2 subschemas\n#/reference_id: expected: null, found: String\n#/reference_id: expected maxLength: 50, actual: 52\n'}

In the logs themselves im getting:

2021-04-24 04:30:34,093Z tap - WARNING Removed paths list: ['billing_address.object', 'billing_address.validation_status', 'cf_guid', 'cf_is_migrated', 'cf_password_hash', 'cf_verified', 'payment_method.gateway_account_id']

2021-04-24 04:30:34,114Z tap - WARNING Removed paths list: ['dunning_attempts', 'line_item_taxes.0.object', 'line_item_taxes.1.object', 'line_items.0.customer_id', 'line_items.1.customer_id', 'shipping_address.object', 'shipping_address.validation_status', 'taxes.0.object']

And lots more of the same error just with different attributes.

Setup is CB-Singer/Stitch-BigQuery

I tried to set up a second connection and create new tables fresh, but the same error persists even with a clean setup.

Updated: Could it be related to this (https://github.com/singer-io/tap-xero/issues/17)

NachoJusticia commented 3 years ago

I am getting the same warning and don't know how to fix it:

WARNING Removed paths list: ['cancel_schedule_created_at', 'cf_custom_name']
WARNING Removed 2 paths during transforms:
    cancel_schedule_created_at
    cf_custom_name
NachoJusticia commented 3 years ago

I think the problem is that those fields are chargebee custom fields, and they don't appear in catalog.json