Out of memory after running a few hours

zbryikt / ptt-crawler

crawl ptt articles from its website

35 stars 16 forks source link

Open youchenlee opened 10 years ago

youchenlee commented 10 years ago

crawler.ls running out of memory after a few hours running.

youchenlee commented 9 years ago

It had been a long time since I encountered this issue, you may close it cause I don't have any detail infomation.

It may be a memory leak somewhere or just the json file growing too big to load into the memory.