search

fnneves / amazon_webscraper

Simple function that will get product prices and other information from product URLs provided in a csv file.
55 stars 50 forks source link

'NoneType' object has no attribute 'get_text' error #1

Closed malay-ruparel closed 3 years ago

malay-ruparel commented 3 years ago

Download your source code and installed following dependencies in anaconda:

glob3 beautifulsoup4 pandas xlrd

Getting following error on its execution

File "D:\Malay\Personal\gift\data\amazon_webscraper-master\Amazon_Scraper.py", line 50, in search_product_list title = soup.find(id='productTitle').get_text().strip()

AttributeError: 'NoneType' object has no attribute 'get_text'

Can anyone please suggest to take it forward?

malay-ruparel commented 3 years ago

Did following changes

  1. Changed the agent as required
  2. Modified line #121 to remove the hard coded folder path and replace it with relative path of 'search_history/*.xlsx'