search

spritt82 / harvestman-crawler

Automatically exported from code.google.com/p/harvestman-crawler
0 stars 0 forks source link

Docs: How to increase limit of connections to single server. #29

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
In the source code for connector.py the below comment is included - 
however it is not immediately obvious either:

 a) what the limit is for concurrent connections to a single host
 b) how / where to increase this limit. 

<snip from lib/connector.py>
        # Even if the number of connections is
        # below the maximum, the number of requests
        # to the same server can exceed the maximum
        # count. So check for that condition. If
        # the number of current active requests to
        # the server is equal to the maximum allowd
        # this call will also block the calling
        # thread
        self._sema.acquire()
</snip>

Please could you let us know where to alter this restraint. 

Thanks
Cres

Original issue reported on code.google.com by cres...@gmail.com on 16 Sep 2009 at 2:57

GoogleCodeExporter commented 9 years ago 
Will take care of this in next release and perhaps add a wiki page for this- 
THank
you for reporting.

Original comment by abpil...@gmail.com on 11 Feb 2010 at 7:06