search

gabrielflorit / file-geocoder

Geocodes a file (JSON or CSV). Requires a Google-style geocoder.
MIT License
24 stars 3 forks source link

out of memory for large CSV #9

Closed derekeder closed 9 years ago

derekeder commented 10 years ago

I tried using this library for a csv that contains over 300,000 records, but got a memory error:

Importing 383,089 records into towing_data.db... done.

FATAL ERROR: CALL_AND_RETRY_2 Allocation failed - process out of memory

Any thoughts on how to increase memory allocation or what the maximum is?

gabrielflorit commented 10 years ago

Hmm - did the FATAL ERROR happen immediately after importing, or after geocoding completion?

derekeder commented 10 years ago

I believe it happened right after import.

gabrielflorit commented 10 years ago

This might be of use: http://stackoverflow.com/a/17816977/64372

derekeder commented 10 years ago

Thanks! I'll try it out.

On Tue, Jan 21, 2014 at 8:55 PM, Gabriel Florit notifications@github.comwrote:

This might be of use: http://stackoverflow.com/a/17816977/64372

— Reply to this email directly or view it on GitHubhttps://github.com/gabrielflorit/file-geocoder/issues/9#issuecomment-32989249 .

Derek Eder @derekeder https://twitter.com/#!/derekeder derekeder.com derek.eder@gmail.com