search

wizicer / gulp-csvtojson

csv to json converter for gulp
MIT License
3 stars 1 forks source link

The plugin fails with big CSV files. #6

Open cyberixae opened 7 years ago

cyberixae commented 7 years ago

I attempted to use gulp-csvtojson with a CSV file that was approximately 300MB in size. This causes gulp-csvtojson to crash. The problem seems to be that gulp-csvtojson attempts to read the entire file into a string which fails if the file size exceeds the maximum string length.

wizicer commented 7 years ago

Thanks for your finding, seems we could utilize the createReadStream method to avoid this problem.

ref to: https://github.com/Keyang/node-csvtojson/issues/79

However, I may not have time work on this recently.