minutils / feed-on-feeds

Released in 2003, saw the rise and fall of Google Reader, reached perfection in 2011
http://feedonfeeds.com/
GNU General Public License v2.0
14 stars 9 forks source link

Multithreaded Ajax Updater #35

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
After a long fight with my hosting provider* I now use the manual update
process which is pretty nice -- except it only does one thread at time. 

Do you think you could multithread the manual updater? :) The ajax should
be capable of running multiple requests, just divide up the list of needed
updates and go :D

Just an idea -- could make manual updates much quicker and easier to bear
for those of us not lucky enough to keep a cron job up.

* they blame FOF for casuing PHP processes to spawn and hang from the cron
update...despite the fact that I turned the cron update OFF >.<

Original issue reported on code.google.com by min...@gmail.com on 22 Feb 2008 at 12:21

GoogleCodeExporter commented 9 years ago
I know LiveJournal for one requests that you DON'T multithread in their bots 
policy,
located at http://www.livejournal.com/bots/. See the Rates & Limits section, 
copied
below.

"You are encouraged to cache the results of your bot's requests, which saves us
bandwidth and CPU time. Bots making repeated requests on the same resource 
(URL) in a
short amount of time will be blocked. Please do not multithread your bot to 
access
multiple resources at the same time and do not connect more than five times per 
second."

Original comment by ebass...@gmail.com on 4 Apr 2008 at 7:25