search

transferwise / pipelinewise-target-postgres

Singer.io Target for PostgreSQL - PipelineWise compatible
https://transferwise.github.io/pipelinewise/
Other
21 stars 39 forks source link

CSV file uses wrong file format (uses JSON instead of CSV) #131

Open cwegener opened 10 months ago

cwegener commented 10 months ago

This is a most obvious bug, but somehow I'm the first person to report this?

https://github.com/transferwise/pipelinewise-target-postgres/blob/bef5a2786afab3c1600e62a77b6d121625e7bc8e/target_postgres/db_sync.py#L351

The Postgresql COPY command does NOT support reading JSON formatted files. It only supports CSV formatted files (and Binary and Text formats)

https://www.postgresql.org/docs/current/sql-copy.html