Closed kevin-ZZZ closed 5 years ago
There is an example of how to create your own spider in the docs. I think the CrawlSpider
is a more simplistic approach to the regular Spider
class, so you may want to look at how the logic is different inside of each class, but otherwise the high level goal should be the same.
You should be able to add some primitive logic to the spiders of this project to get the same behavior the CrawlSpider
gives you, but following the guide above.