search

chchgb / android-crawler

Automatically exported from code.google.com/p/android-crawler
0 stars 0 forks source link

Manage task list from disk #35

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
The task list can become a very huge object, and keeping it in RAM would have a 
severe impact on performance.

Since we already store it on disk, we could go one step further and do 
scheduling from disk. For simple strategies (FIFO, LIFO, random) the extraction 
of a new task is straight forward and won't require the storage of metadata. 
For "smarter" strategies, some sort of information on the stored tasks should 
be kept in RAM.

Original issue reported on code.google.com by nofatclips on 4 Dec 2011 at 10:06