froulet / instagram-spider

An instagram spider for scrapy. Get all the photos from a public instagram account.
48 stars 20 forks source link

Stopped working, haven't checked yet. #2

Open biogk opened 6 years ago

biogk commented 6 years ago

[scrapy.core.scraper] ERROR: Spider error processing <GET https://www.instagram.com//> (referer: https://www.instagram.com//) Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/scrapy/utils/defer.py", line 102, in iter_errback yield next(it) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/scrapy/spidermiddlewares/offsite.py", line 30, in process_spider_output for x in result: File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/scrapy/spidermiddlewares/referer.py", line 339, in return (_set_referer(r) for r in result or ()) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/scrapy/spidermiddlewares/urllength.py", line 37, in return (r for r in result or () if _filter(r)) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/scrapy/spidermiddlewares/depth.py", line 58, in return (r for r in result or () if _filter(r)) File "instagram_spider.py", line 58, in parse_page user = locations['entry_data']['ProfilePage'][0]['user'] KeyError: 'user'

froulet commented 6 years ago

Thanks for opening an issue ! Indeed, it looks like Instagram changed its front-end API. I will try to take a look at it when I have the time.

biogk commented 6 years ago

I will also try when I got time.haha

jiggerj commented 6 years ago

runspider: error: Unable to load 'instagram_spider.py': DLL load failed: The specified module could not be found.