search

transferwise / pipelinewise-target-redshift

Singer.io Target for Amazon Redshift - PipelineWise compatible
https://transferwise.github.io/pipelinewise/
Other
12 stars 65 forks source link

Add optional validation_records parameter #56

Closed koszti closed 4 years ago

koszti commented 4 years ago

Adds validate_records option:

(Default: False) Validate every single record message to the corresponding JSON schema. This option is disabled by default and invalid RECORD messages will fail only at load time by Redshift. Enabling this option will detect invalid records earlier but could cause performance degradation.

Redshift equivalent of PR https://github.com/transferwise/pipelinewise-target-snowflake/pull/54 and PR https://github.com/transferwise/pipelinewise-target-snowflake/pull/55