jwills / target-duckdb

A Singer.io target for DuckDB
Other
17 stars 12 forks source link

Include delim/quote chars in COPY config #34

Open jwills opened 7 months ago

jwills commented 7 months ago

Problem

Handling complex records with lots of newlines (of various flavors) in individual fields + probably improving import performance as a side-effect

Proposed changes

Do the very obvious thing and include the quote/delim characters in the config of the COPY statement passed to DuckDB.

Types of changes

Checklist