NikolaiT / GoogleScraper

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
https://scrapeulous.com/
Apache License 2.0
2.64k stars 743 forks source link

GoogleScraper with python-anaconda #108

Open paulz1 opened 9 years ago

paulz1 commented 9 years ago

I use python 2.6 on my system, so to install GoogleScraper I installed python-anaconda ( https://store.continuum.io/cshop/anaconda/ ) which is Python 3.4.3.

Then I installed GoogleScraper using pip. It was installed without problem. All of dependencies are present as well.

But now, when I try to use GoogleScraper it does not work :

Traceback (most recent call last): File "~/.conda/envs/my_python_anaconda/bin/GoogleScraper", line 9, in load_entry_point('GoogleScraper==0.1.37', 'console_scripts', 'GoogleScraper')() File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/setuptools-12.0.4-py3.4.egg/pkg_resources/init.py", line 519, in load_entry_point File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/setuptools-12.0.4-py3.4.egg/pkg_resources/init.py", line 2630, in load_entry_point File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/setuptools-12.0.4-py3.4.egg/pkg_resources/init.py", line 2310, in load File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/setuptools-12.0.4-py3.4.egg/pkg_resources/init.py", line 2316, in resolve File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/GoogleScraper/init.py", line 20, in from GoogleScraper.core import scrape_with_config File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/GoogleScraper/core.py", line 13, in from GoogleScraper.caching import fix_broken_cache_names, _caching_is_one_to_one, parse_all_cached_files, \ File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/GoogleScraper/caching.py", line 16, in from GoogleScraper.output_converter import store_serp_result File "~/.conda/envs/my_python_anaconda/lib/python3.4/site-packages/GoogleScraper/output_converter.py", line 19, in csv_fieldnames = set(Link.table.columns._data.keys() + SERP.table.columns._data.keys()) - {'id', 'serp_id'} TypeError: unsupported operand type(s) for +: 'list_iterator' and 'list_iterator'

Do you have any idea?

Thank you very much.

Thanks, PaulZ

mhenes commented 8 years ago

I get the same error.