Closed captjt closed 7 years ago
Because of the data race issues I had to set the maximum size of the crawler to only hit ~3600 sites or so for now.
Because of the data race issues I had to set the maximum size of the crawler to only hit ~3600 sites or so for now.