AlanSwenson / amz-review-scraper

This project scrapes Amazon listings for recent reviews of specified products (ASIN) and stores them in a Postgres DB, example running below
https://peachtools.com
3 stars 1 forks source link

Here is the error from terminal #4

Closed AlanSwenson closed 6 years ago

AlanSwenson commented 6 years ago

An Error Occured While Scraping Traceback (most recent call last): File "app.py", line 44, in main() File "app.py", line 35, in main amazon.scrape(url, asin) File "/Users/alanswenson/projects/amz-review-scraper/amz-review-scraper/amzscraper.py", line 26, in scrape raw_html = requests.get(url, headers=header, proxies=proxies) File "/Users/alanswenson/.local/share/virtualenvs/amz-review-scraper-SIwdd7Z0/lib/python3.6/site-packages/requests/api.py", line 75, in get return request('get', url, params=params, kwargs) File "/Users/alanswenson/.local/share/virtualenvs/amz-review-scraper-SIwdd7Z0/lib/python3.6/site-packages/requests/api.py", line 60, in request return session.request(method=method, url=url, kwargs) File "/Users/alanswenson/.local/share/virtualenvs/amz-review-scraper-SIwdd7Z0/lib/python3.6/site-packages/requests/sessions.py", line 515, in request prep.url, proxies, stream, verify, cert File "/Users/alanswenson/.local/share/virtualenvs/amz-review-scraper-SIwdd7Z0/lib/python3.6/site-packages/requests/sessions.py", line 690, in merge_environment_settings no_proxy = proxies.get('no_proxy') if proxies is not None else None AttributeError: 'str' object has no attribute 'get'

@davidbegin