search

jimhigson / oboe.js

A streaming approach to JSON. Oboe.js speeds up web applications by providing parsed objects before the response completes.
http://oboejs.com
Other
4.78k stars 208 forks source link

Large JSON question #189

Open hrdwdmrbl opened 5 years ago

hrdwdmrbl commented 5 years ago

I'm interesting in parsing very large stringified JSON strings (up to 2GB). I have the string in memory, but the problem I have is that JSON.parse takes too long to do the parsing. So I'm looking at solutions like oboe.js to progressively parse. What I'm wondering is whether oboe blocks while parsing? Does it ever use setImmediate or yield or something like that so that the node event-loop can run something else and then come back to oboe?

Aigeec commented 4 years ago

It probably should if it doesn't. Will confirm.