search

nicolas-gervais / predicting-car-price-from-scraped-data

Picture and specifications scraper
415 stars 124 forks source link

run main.py #6

Open tkone2018 opened 4 years ago

tkone2018 commented 4 years ago

hello, thanks for your codes, when i run the main.py, i met a problem like this: scrape.py started running. Traceback (most recent call last): File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/scrape.py", line 92, in run(sys.argv[1]) File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/scrape.py", line 78, in run a = all_makes() File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/scrape.py", line 20, in all_makes for a in fetch(website, "/new-cars").find_all("a", {"class": "add-zip"}): File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/scrape.py", line 15, in fetch 'lxml') File "D:\python3.6\lib\site-packages\bs4__init.py", line 245, in init % ",".join(features)) bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: lxml. Do you need to install a parser library? tag.py started running. Traceback (most recent call last): File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/tag.py", line 69, in run() File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/tag.py", line 11, in run df = pd.read_csv('specs-and-pics.csv', dtype=str, index_col=0).T File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 676, in parser_f return _read(filepath_or_buffer, kwds) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 448, in _read parser = TextFileReader(fp_or_buf, kwds) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 880, in init self._make_engine(self.engine) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 1114, in _make_engine self._engine = CParserWrapper(self.f, self.options) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 1891, in init self._reader = parsers.TextReader(src, kwds) File "pandas_libs\parsers.pyx", line 374, in pandas._libs.parsers.TextReader.cinit File "pandas_libs\parsers.pyx", line 674, in pandas._libs.parsers.TextReader._setup_parser_source FileNotFoundError: [Errno 2] File specs-and-pics.csv does not exist: 'specs-and-pics.csv' Traceback (most recent call last): File "F:/BONC/vehicle/predicting-car-price-from-scraped-data/picture-scraper/save.py", line 15, in df = pd.read_csv('id_and_pic_url.csv') File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 676, in parser_f return _read(filepath_or_buffer, kwds) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 448, in _read parser = TextFileReader(fp_or_buf, kwds) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 880, in init self._make_engine(self.engine) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 1114, in _make_engine self._engine = CParserWrapper(self.f, **self.options) File "D:\python3.6\lib\site-packages\pandas\io\parsers.py", line 1891, in init__ self._reader = parsers.TextReader(src, kwds) File "pandas_libs\parsers.pyx", line 374, in pandas._libs.parsers.TextReader.cinit File "pandas_libs\parsers.pyx", line 674, in pandas._libs.parsers.TextReader._setup_parser_source FileNotFoundError: [Errno 2] File id_and_pic_url.csv does not exist: 'id_and_pic_url.csv' and i have a question about the srape.py:** def fetch(page, addition=''): return bs.BeautifulSoup(urlopen(Request(page + addition, headers={'User-Agent': 'Opera/9.80 (X11; Linux i686; Ub' 'untu/14.10) Presto/2.12.388 Version/12.16'})).read(), 'lxml') can you help me? thank you