EC2 micro instance running out of memory when scraping

open-city / councilmatic

DEPRECATED, replaced by https://github.com/datamade/chi-councilmatic

16 stars 9 forks source link

EC2 micro instance running out of memory when scraping #3

Closed derekeder closed 11 years ago

derekeder commented 11 years ago

SPIKE: Either limit memory usage or get a bigger instance.

Feb  4 18:51:14 ip-10-245-25-135 kernel: [1474786.933970] Out of memory: Kill process 4713 (python) score 93 or sacrifice child
Feb  4 18:51:14 ip-10-245-25-135 kernel: [1474786.933977] Killed process 4713 (python) total-vm:327172kB, anon-rss:56376kB, file-rss:0kB

derekeder commented 11 years ago

seems to have been resolved with latest legistar-scraper fixes