"allocation size overflow" error on large files

[mef]

Hi, The following error shows up in the console when processing large CSV files

allocation size overflow    > papaparse.js:710:4

how to reproduce

• have a large CSV file available in your computer (e.g. 250MB)
• head to the [papaparse demo site[(https://www.papaparse.com/demo)
• Go to Local File(s), upload your file, press 'Parse')

expected result

Parse result shows up in the console

actual result

Error quoted above happens.

First noticed it when working on my own csv to json converter based on papaparse: works perfectly when using complete callback, the error only happens when introducing chunk function.

[pokoli]

Which browser are you using? It seems that firefox has an allocattion limit of 250MB which throws this erro.

Probably using workers to split up the work in chunks will solved this use. Could you confirm?

[mef]

Firefox, indeed.