Does not Work with Amazon.de / Amazon Europe

scrapehero-code / amazon-scraper

A simple web scraper to extract Product Data and Pricing from Amazon

https://www.scrapehero.com/tutorial-how-to-scrape-amazon-product-details-using-python-and-selectorlib/

310 stars 158 forks source link

Does not Work with Amazon.de / Amazon Europe #2

Open rene-schwabe opened 3 years ago

rene-schwabe commented 3 years ago

If we use the scraper for every other Amazon Marketplace, like Amazon.de we get the following error:

Downloading https://www.amazon.de/s?k=laptop
Traceback (most recent call last):
  File "searchresults.py", line 43, in <module>
    for product in data['products']:
TypeError: 'NoneType' object is not iterable

When we use the SelectorLib Google Chrome Plugin, the markups are okay. We can see the prices, title, ratings e.g.

motis10 commented 3 years ago

Its happen to me too

thethinker990 commented 3 years ago

But happens to me with amazon.com, too.

Denamet commented 3 years ago

MuhsinunC commented 3 years ago

The bot was working for me just fine for quite a few hours before it started doing this. I'm thinking shadowbanned? I can still use Amazon just fine on chrome or incognito though.

EDIT: Changing my user agent fixed it.