Simple fix for the TypeError coming from pickle. It is coming from the Job.from_xpath function. In parse you need to extract the data from response.xpath or else it will not be pickled properly. Granted, this is an issue on Scrapy's end, but this fixes the issue now.
Simple fix for the
TypeError
coming from pickle. It is coming from theJob.from_xpath
function. Inparse
you need to extract the data fromresponse.xpath
or else it will not be pickled properly. Granted, this is an issue on Scrapy's end, but this fixes the issue now.In
scrapyscript.py
In
tests.py
I have a fix on my end, but am unable to create a new pull request.