shenwei356 / csvtk

A cross-platform, efficient and practical CSV/TSV toolkit in Golang
http://bioinf.shenwei.me/csvtk
MIT License
992 stars 84 forks source link

fix-quotes: [ERRO] bufio.Scanner: token too long #283

Closed joverlee521 closed 4 weeks ago

joverlee521 commented 1 month ago

Prerequisites

Describe your issue

As a follow up to https://github.com/shenwei356/csvtk/issues/130, I am trying to wrap csvtk pipelines with fix-quotes and del-quotes when working with TSVs, but I'm running into an error with fix-quotes:

[ERRO] bufio.Scanner: token too long

Seems like this error was previously reported for space2tab in https://github.com/shenwei356/csvtk/issues/231. Can the same -b, --buffer-size flag be added to fix-quotes?

Thank you

I'm grateful to users who have greatly helped to report bugs and suggested new features.

I may respond to issues or fix bugs quickly, but I usually implement new features periodically (two or more weeks).

shenwei356 commented 1 month ago

It's fixed: https://github.com/shenwei356/csvtk/commit/ee688fb7e058cc6acd6f0719a35e5ffacd35fb16

Please use binaries here: https://github.com/shenwei356/csvtk/issues/282