Open GoogleCodeExporter opened 9 years ago
I know LiveJournal for one requests that you DON'T multithread in their bots
policy,
located at http://www.livejournal.com/bots/. See the Rates & Limits section,
copied
below.
"You are encouraged to cache the results of your bot's requests, which saves us
bandwidth and CPU time. Bots making repeated requests on the same resource
(URL) in a
short amount of time will be blocked. Please do not multithread your bot to
access
multiple resources at the same time and do not connect more than five times per
second."
Original comment by ebass...@gmail.com
on 4 Apr 2008 at 7:25
Original issue reported on code.google.com by
min...@gmail.com
on 22 Feb 2008 at 12:21