search

thequbit / BarkingOwl

scalable web scraper framework for finding documents on websites.
GNU General Public License v3.0
19 stars 7 forks source link

Scrapers do not pull down next URL correctly. #25

Closed thequbit closed 9 years ago

thequbit commented 10 years ago

I'm not sure if this is a scraper issue or a dispatcher issue, but once a scraper completes, it does not get issues the next URL.

thequbit commented 9 years ago

This looks to be fixed in 0.6.0 with new communications threading model.