Open MADDY312 opened 2 years ago
Hey bud, I know this is pretty old in the ways of development but I thought I'd answer your question.
To start things off, you have an issue with your init method using only a single underscore (init) instead of two (init).
Next, you're not utilizing Scrapy-Selenium here. You're directly calling Selenium manually without the help of this package. This package let's you setup and use Selenium through a DownloaderMiddleware , which is where we want this code to be, not directly in our Spider class.
Third, I'm fairly certain the maintainer of this project either isn't around or has dropped the project. I've forked it to bring it up to date and essentially become the new maintainer, as I found a use for this package myself.
p.s. Owner, if you're reading this, please let us know if this project is still being maintained or if you've moved on :)
code :
It appears that compiler does not execute the init function before going to parse function, because neither of the print statements are getting executed but the print statement in parse function is present in the output How to fix this?
Output: