search

rugantio / fbcrawl

A Facebook crawler
Apache License 2.0
661 stars 229 forks source link

fixed issue #62 #68

Closed Di-ref closed 3 years ago

Di-ref commented 4 years ago

fixed issue #62 by eliminating some empty comments that are triggering a bug in the Scrapy library. link to the issue in the Scrapy repository

ACLemain commented 3 years ago

Hi @Di-ref - I cloned your fbcrawl fork, but I still get the error: ...\anaconda3\envs\Facebook\lib\ast.py", line 47, in parse return compile(source, filename, mode, flags, File "", line 1 def parse_page(self, response): ^

Or did you fix it elsewhere?

Di-ref commented 3 years ago

Hi @Di-ref - I cloned your fbcrawl fork, but I still get the error: ...\anaconda3\envs\Facebook\lib\ast.py", line 47, in parse return compile(source, filename, mode, flags, File "", line 1 def parse_page(self, response): ^

Or did you fix it elsewhere?

Hi, after some investigation it turns out that some empty docstrings actually triggering a bug in an older version of the Scrapy library (which was fixed btw), but it seems like the code for fbcrawl is no longer maintained to undergo these changes and i dont think it will be updated any time soon, unfortunately.