search

buckyroberts / Spider

Python website crawler.
https://thenewboston.com/
966 stars 668 forks source link

queue not crawling #65

Open Aryanka opened 5 years ago

Aryanka commented 5 years ago

Screenshot (145)

Here is my output. How can i resolve this. somebody pls help

Augmented-Fox commented 4 years ago

Screenshot (145)

Here is my output. How can i resolve this. somebody pls help

Could you post your init function from your linkfinder file. The problem could lie in there.

p-venkatesh commented 3 years ago

how to clear this error

p-venkatesh commented 3 years ago
Screenshot 2020-11-27 at 10 27 55 PM
TheHysteresis commented 3 years ago

I am having a similar experience, however no error message; the program just stops after queuing one link, and exits successfully. I have checked all my code against the code posted here, and I see no discrepancy. Does anyone have any suggestions?

Creating Directory Crawler_Test First Spider Now Crawling https://www.crawler-test.com/ Queued Links: 1 | Crawled 0

Process finished with exit code 0