search

timothywangdev / ConversationalAgent

Conversational Agent
1 stars 0 forks source link

memory issue while loading large json files #4

Open timothywangdev opened 9 years ago

timothywangdev commented 9 years ago

using ijson?

timothywangdev commented 9 years ago

commit ec359bcc014450111d71ef3b3548d8ff892db2c2 didn't resolve this issue, data_file.read() still loads the entire file as a string

timothywangdev commented 9 years ago

Made it working on my machine (Python 2.7.6, RC_2015-03 (32.6 GB, time: 02:32:34)). Still need more testing to confirm this actually works.