search

transferwise / pipelinewise-tap-mongodb

Singer.io Tap for MongoDB - PipelineWise compatible
GNU Affero General Public License v3.0
5 stars 24 forks source link

schema inference #73

Open sjcotto opened 2 years ago

sjcotto commented 2 years ago

Hi,

I notice the schema is generated with id and document JSON and not the properties of the document, how is possible to use this with the https://github.com/transferwise/pipelinewise-target-postgres loader in order to send a JSON from mongodb into a table with columns in postgresql?

"name": "a", "description": "aa"

into a table with the 2 columns name and description

any help?

Samira-El commented 2 years ago

Hi, try using data_flattening_max_level feature of https://github.com/transferwise/pipelinewise-target-postgres .

kimus commented 1 year ago

Defining the property data_flattening_max_level with a value higher then 0 will load a NULL document!