cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.1k stars 3.81k forks source link

sqlccl: make IMPORT CSV tolerant of data errors #25751

Open knz opened 6 years ago

knz commented 6 years ago

Reported in #25480

If any line in the CSV file contains erroneous (unparsable/incorrect data), the entire IMPORT job fails. This is poor UX, because the amount of work needed to correct the data might be negligible compared to the time needed to complete the IMPORT job.

Each of the following alternatives would be better UX, and the combination of them even better:

Jira issue: CRDB-5695

msbutler commented 2 years ago

triaging to sql-exp as new owners of this.

Ideally ,the log_ignored_statements option should no longer be undocumented and experimental for IMPORT INTO.