search

tasfe / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 1 forks source link

Remove Hard-Coded Sleeps #256

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Remove the hard coded sleeps in the monitor thread. 

The monitor thread has 4 places where it waits for 10 seconds. While it is not 
that important when the crawler runs the whole night, but in our case we just 
crawl a service regisrty for XSD files which takes only a few seconds.

We have checked out the sources and made the waiting period configurable.

Original issue reported on code.google.com by codehust...@gmail.com on 18 Feb 2014 at 11:01

GoogleCodeExporter commented 9 years ago

Original comment by avrah...@gmail.com on 18 Aug 2014 at 3:49