SinghalHarsh / amazon-product-review-scraper

Python package to scrape product review data from amazon
MIT License
23 stars 8 forks source link

AttributeError: 'NoneType' object has no attribute 'tbody'` #7

Open julianchow513 opened 1 year ago

julianchow513 commented 1 year ago
from amazon_product_review_scraper import amazon_product_review_scraper
review_scraper = amazon_product_review_scraper(amazon_site="amazon.ca", product_asin="B09NPS8ZXC")
IDE and Envs\Anaconda3\lib\site-packages\amazon_product_review_scraper\amazon_product_review_scraper.py in __init__(self, amazon_site, product_asin, sleep_time, start_page, end_page)
     27         self.reviews_dict = {"date_info":[], "name":[], "title":[], "content":[], "rating":[]}
     28 
---> 29         self.proxies = self.proxy_generator()
     30         self.max_try = 10
     31         self.ua = ua.random

IDE and Envs\Anaconda3\lib\site-packages\amazon_product_review_scraper\amazon_product_review_scraper.py in proxy_generator(self)
    168         soup = BeautifulSoup(response.content, 'html.parser')
    169         proxies_table = soup.find(id='proxylisttable')
--> 170         for row in proxies_table.tbody.find_all('tr'):
    171             proxies.append({
    172                 'ip':   row.find_all('td')[0].string,

AttributeError: 'NoneType' object has no attribute 'tbody'
usmanyaqoob49 commented 7 months ago

same error