ContentMine / quickscrape

A scraping command line tool for the modern web
MIT License
259 stars 43 forks source link

All quickscrape requests result in "error: undefined" #22

Closed ryscher closed 10 years ago

ryscher commented 10 years ago

I've tried several json definitions, including Example 1 on https://github.com/ContentMine/quickscrape. All of them create the output directory but no output files. All of them result in "error: undefined"

ryscher commented 10 years ago

For example....

info:    quickscrape launched with...
info:    - URL: https://peerj.com/articles/384
info:    - Scraper: journal-scrapers/scrapers/peerj.json
info:    - Rate limit: 3 per minute
info:    - Log level: debug
info:    urls to scrape: 1
debug:   scraperJSON definition is valid
debug:   creating output directory: peerj-384
info:    processing URL: https://peerj.com/articles/384
debug:   creating output directory: /Users/ryan/lib/content-mine/peerj-384/https_peerj.com_articles_384
error:   
error:   undefined
blahah commented 10 years ago

@ryscher what version of quickscrape are you using? (quickscrape --version will tell you)

mcs07 commented 10 years ago

Hi - I was just trying out Quickscrape this afternoon and had the same problem. I filed a fix pull request here: https://github.com/ContentMine/quickscrape/pull/23

ryscher commented 10 years ago

I have verified that the new version works. Thanks!