search

transferwise / pipelinewise-target-redshift

Singer.io Target for Amazon Redshift - PipelineWise compatible
https://transferwise.github.io/pipelinewise/
Other
12 stars 65 forks source link

Not flattening all columns #73

Open gbachRM opened 3 years ago

gbachRM commented 3 years ago

I have found when running with flattening enabled (I have tried various values for the max level value) that not all columns are flattened.

Some are done perfectly, others are left fully nested.

Any help on how to make adjustments to have all columns broken out would be greatly appreciated.

Also, I noticed it flattens within the same table and adds additional columns, this is fine, but is there a way for these flattened columns to be broken out into their own tables.

Thanks!

gbachRM commented 3 years ago

target-postgress does an amazing job at this. Could be a good place to look and see how it is done there.