search

tomnomnom / gron

Make JSON greppable!
MIT License
13.76k stars 326 forks source link

Inexplicably high memory usage #50

Open admjls opened 6 years ago

admjls commented 6 years ago

When trying to process a 3GB JSON file on a machine with 62GB of available RAM, gron terminates (after about an hour) with the message fatal error: runtime: out of memory.

Out of curiosity, I spun up an r4.4xlarge in AWS and let it chew on the file - peak memory usage approached ~98GB (of 120GB free).

nirmalpatel94 commented 1 week ago

Same issue for me in 2024 😅

I was unable to use gron with a ~2.2gb JSON file as my 32GB computer was getting dangerously close to running out of memory before I killed it. macOS memory pressure was in the red territory and my other apps were starting to slow down. It was using ~40gb combined memory before I quit it.