In DefaultSpider, the parse methods for the parser classes are called by URLs, for example the parse_debian method is called if a debian security tracker URL is found. This is wrong.
Either these parsers should be called before crawling the entrypoint URLs, or a sophisticated way to call these parse methods without a URL is required.
In DefaultSpider, the parse methods for the parser classes are called by URLs, for example the parse_debian method is called if a debian security tracker URL is found. This is wrong.
Either these parsers should be called before crawling the entrypoint URLs, or a sophisticated way to call these parse methods without a URL is required.