Closed Pemh closed 1 year ago
I can confirm this issue, @VMRuiz reported this to me a few days ago.
Whether it is an issue on scrapy-poet or on Scrapy, I do not know.
Thanks for reporting. I think I found the problem.
@Pemh can you try installing and using scrapy-poet
from the branch of this PR to see if it fully works on your end? https://github.com/scrapinghub/scrapy-poet/pull/94
Thanks
It works, well done! Should I close the issue myself?
Should I close the issue myself?
No need, we will close it as we merge #94.
Running scrapy shell raises an error because no spider is passed to the crawler in Injector instance (scrapy-poet v0.6.0).
The Injector class:
When unabling
scrapy_poet.InjectionMiddleware
and runningscrapy shell <url>
the crawler parameter initializing theInjector
provided byInjectionMiddleware
does not contain a spider.The command
scrapy shell <url>
is supposed to create several objects including a spider: "the Spider which is known to handle the URL, or a Spider object if there is no spider found for the current URL." sourceProviding a valid spider with the
--spider
option raises the same error:This error is not raised when running
scrapy crawl
.