mchangrh / sb-mirror

Docker containers to mirror the SponsorBlock database + API
Other
191 stars 29 forks source link

mangle/ workaround for bad csv #12

Open mchangrh opened 2 years ago

mchangrh commented 2 years ago

postgres exports csvs with "" indicating an empty field, which is interpreted as single escape. Either SQLite will have to read from mangled stdin or another tool will be needed to import to sqlite

mchangrh commented 2 years ago

this might have to be fixed upstream since some of the rows are multiline and not escaped properly