I'm unable to open a very large (621MB) JSON Lines file. I get the following error:
Unable to parse data file: 'performance-2021-07-20_19-09-43.jsonl'.
Line #: 1 Error: Cannot create a string longer than 0x1fffffe8 characters
Each line within the file is less than 500 characters so I assume it is trying to read the file into one massive string. Ideally it should be read line-by-line as the format was intended to be read that way.
Unfortunately I cannot give this data out but it shouldn't be too hard to replicate.
RandomFractals
commented
3 years ago
I'm unable to open a very large (621MB) JSON Lines file. I get the following error:
Each line within the file is less than 500 characters so I assume it is trying to read the file into one massive string. Ideally it should be read line-by-line as the format was intended to be read that way.
Unfortunately I cannot give this data out but it shouldn't be too hard to replicate.