When I run meltano tap-coingecko target-jsonl I am able to load raw json fields with th.AnyType() or th.CustomType({"anyOf": [{"type": "object"}, {"type": "array"}, {}]}). However when using target-bigquery (target-snowflake fails as well) the loader fails. Maybe there's a simple parameter I'm missing / misunderstanding? Here's my setup:
When using th.AnyType() defined as my schema I can see the jsonl file successfully loaded into the gcs bucket. The problem is with the below "platforms" json field. Downloading the file here's the last record:
When I run
meltano tap-coingecko target-jsonl
I am able to load raw json fields withth.AnyType()
orth.CustomType({"anyOf": [{"type": "object"}, {"type": "array"}, {}]})
. However when usingtarget-bigquery
(target-snowflake
fails as well) the loader fails. Maybe there's a simple parameter I'm missing / misunderstanding? Here's my setup:When using
th.AnyType()
defined as my schema I can see the jsonl file successfully loaded into the gcs bucket. The problem is with the below "platforms" json field. Downloading the file here's the last record:The error with
th.AnyType()
isThe error with
th.CustomType({"anyOf": [{"type": "object"}, {"type": "array"}, {}]})
is: