search

prncc / steam-scraper

A pair of spiders for scraping product data and reviews from Steam.
https://intoli.com/blog/steam-scraper/
77 stars 39 forks source link

Running more than one spider #3

Closed SirOggy closed 6 years ago

SirOggy commented 6 years ago

Hey, I'm still somewhat new to python and thought I'd give this project a go so I can learn python along the way, so this may be a simple issue, but it is really frustrating me.

Basically, I put in the command: scrapy crawl products -o output/products_all.jl --logfile=output/products_all.log \ --loglevel=INFO -s JOBDIR=output/products_all_job -s HTTPCACHE_ENABLED=False

However, I keep getting the error: crawl: error: running 'scrapy crawl' with more than one spider is no longer supported

Any help would be much appreciated, Thank you!

SirOggy commented 6 years ago

Actually... I did make some progress, but now I'm stuck with: Unhandler error in Deferred:

It has nothing after it. This is still happening from running the same command.