2021-07-07 13:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mbasic.facebook.com/cookie/consent-page/?next_uri=https%3A%2F%2Fmbasic.facebook.com%2F&refsrc=deprecated&_rdr> (referer: None) 2021-07-07 13:48:42 [scrapy.core.scraper] ERROR: Spider error processing <GET https://mbasic.facebook.com/cookie/consent-page/?next_uri=https%3A%2F%2Fmbasic.facebook.com%2F&refsrc=deprecated&_rdr> (referer: None) Traceback (most recent call last): File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/twisted/internet/defer.py", line 662, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/scrapy/spiders/__init__.py", line 90, in _parse return self.parse(response, **kwargs) File "/home/adam/research/fbcrawl/fbcrawl/spiders/fbcrawl.py", line 90, in parse return FormRequest.from_response( File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/scrapy/http/request/form.py", line 48, in from_response form = _get_form(response, formname, formid, formnumber, formxpath) File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/scrapy/http/request/form.py", line 106, in _get_form raise ValueError(f'No <form> element found with {formxpath}') ValueError: No <form> element found with //form[contains(@action, "login")]
I'm using scrapy crawl fb -a email="<email>" -a password="<pass>" -a page="https://www.facebook.com/lodzpl/" -a date="2018-01-01" -a lang="en" -o DUMPFILE.csv command
When trying to login I receive:
2021-07-07 13:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mbasic.facebook.com/cookie/consent-page/?next_uri=https%3A%2F%2Fmbasic.facebook.com%2F&refsrc=deprecated&_rdr> (referer: None) 2021-07-07 13:48:42 [scrapy.core.scraper] ERROR: Spider error processing <GET https://mbasic.facebook.com/cookie/consent-page/?next_uri=https%3A%2F%2Fmbasic.facebook.com%2F&refsrc=deprecated&_rdr> (referer: None) Traceback (most recent call last): File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/twisted/internet/defer.py", line 662, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/scrapy/spiders/__init__.py", line 90, in _parse return self.parse(response, **kwargs) File "/home/adam/research/fbcrawl/fbcrawl/spiders/fbcrawl.py", line 90, in parse return FormRequest.from_response( File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/scrapy/http/request/form.py", line 48, in from_response form = _get_form(response, formname, formid, formnumber, formxpath) File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/scrapy/http/request/form.py", line 106, in _get_form raise ValueError(f'No <form> element found with {formxpath}') ValueError: No <form> element found with //form[contains(@action, "login")]I'm using
scrapy crawl fb -a email="<email>" -a password="<pass>" -a page="https://www.facebook.com/lodzpl/" -a date="2018-01-01" -a lang="en" -o DUMPFILE.csvcommand