singer-io / tap-pipedrive

A Singer.io tap for extracting data from the Pipedrive API
GNU Affero General Public License v3.0
13 stars 34 forks source link

products.prices schema invalid #107

Open JohannesRudolph opened 2 years ago

JohannesRudolph commented 2 years ago

The json schema generated for the product.prices property has "types": ["null", "object", "array"]. This makes it impossible for loaders like target-bigquery to correctly infer the schema. In this case the proper fix would be to drop the object type.

I'm using meltano and tried to override the schema by passing an explicit catalog, but it seems the tap ignores the catalog and always builds the schema on its own.

weltonrodrigo commented 2 years ago

Products is treated as stream with dynamic schema. It's necessary to change code inside the tap.