Open janmichaelyu opened 6 years ago
02020201
"opt out" service Observation DOMAIN DOMAIN 11:16:43.614 [pool-1-thread-1] WARN c.m.contentpump.DocumentMapper - Skipped record: () in file:/homes/local/projects/data-hub/data/omop/all/CONCEPT/CONCEPT.csv at line 1999360, reason: invalid char between encapsulated token and delimiter
We're encountering a similar issue to https://github.com/marklogic/marklogic-contentpump/issues/68 for files that are tab delimited but with unescaped quotes:
Sample:
It would be great if we could get the failed records in a separate file or in the log so we could examine quickly what went wrong during the ingest and see what kind of formatting error we have and fix it.