HumanDynamics / MassScaleSocialSystems

For TweetPing Collaboration on Mass Scale Participatory Projects
1 stars 1 forks source link

Avoid overloading external websites by calls from the spiders #67

Closed DarkSymmetry closed 9 years ago

DarkSymmetry commented 9 years ago

We had the following reply from P-Stats. I suggest we do the same for battle.net (World of Warcraft). Does that solve the issue, @jwalsh ?

You can do sequential requests. So no parallel requests, then you see how long the wait time is per request and you see yourself how much the system can answer in an hour. That's the self regulatory approach. If that is too slow you can increase the parallel sequences from 1 to 2 or more.