Keyang / node-csvtojson

Blazing fast and Comprehensive CSV Parser for Node.JS / Browser / Command Line.
MIT License
2.02k stars 270 forks source link

ignoreColumns is not working #455

Open onsightit opened 1 year ago

onsightit commented 1 year ago

I occasionally get CSVs that have an extra comma on the header and rows. This results in the parser giving me unwanted columns, like 'field18'. I tried using the ignoreColumns option parameter like this:

        const converter = csv({
            noheader: false,
            ignoreColumns: /field\d+$/
        })

Or even hardcoding the column like this:

        const converter = csv({
            noheader: false,
            ignoreColumns: /field18/
        })

But it still gives me these unwanted columns. I suspect it is because 'field18' is not in the header. How can I get around this without deleting the trailing commas? I have an automated process, so manually editing the CSV is not an option.

Thanks!

Kyaw-Zin-Thant commented 1 year ago

I found the option to skip empty data columns, you can use ignoreEmpty.

const converter = csv({ noheader: false, ignoreEmpty: true })