ContentMine / quickscrape

A scraping command line tool for the modern web
MIT License
259 stars 42 forks source link

OSX install fail #1

Closed blahah closed 10 years ago

blahah commented 10 years ago

from @petermr, moved from http://pads.cottagelabs.com/p/contentminescraping

okapi:quickscrape pm286$ sudo npm install --global quickscrape
Password:
npm http GET https://registry.npmjs.org/quickscrape
npm http 304 https://registry.npmjs.org/quickscrape
npm http GET https://registry.npmjs.org/xpath
npm http GET https://registry.npmjs.org/winston
npm http GET https://registry.npmjs.org/which
npm http GET https://registry.npmjs.org/sleep
npm http GET https://registry.npmjs.org/commander
npm http GET https://registry.npmjs.org/spooky
npm http GET https://registry.npmjs.org/jsdom
npm http GET https://registry.npmjs.org/download
npm http 200 https://registry.npmjs.org/which
npm http GET https://registry.npmjs.org/which/-/which-1.0.5.tgz
npm http 304 https://registry.npmjs.org/sleep
npm http 200 https://registry.npmjs.org/xpath
npm http GET https://registry.npmjs.org/xpath/-/xpath-0.0.6.tgz
npm http 200 https://registry.npmjs.org/commander
npm http 304 https://registry.npmjs.org/spooky
npm http 200 https://registry.npmjs.org/winston
npm http 304 https://registry.npmjs.org/download
npm http GET https://registry.npmjs.org/winston/-/winston-0.7.3.tgz
npm http 200 https://registry.npmjs.org/which/-/which-1.0.5.tgz
npm http 200 https://registry.npmjs.org/xpath/-/xpath-0.0.6.tgz
npm http 200 https://registry.npmjs.org/winston/-/winston-0.7.3.tgz
npm http 200 https://registry.npmjs.org/jsdom
npm http GET https://registry.npmjs.org/jsdom/-/jsdom-0.10.6.tgz
npm http 200 https://registry.npmjs.org/jsdom/-/jsdom-0.10.6.tgz
npm http GET https://registry.npmjs.org/get-stdin
npm http GET https://registry.npmjs.org/each-async
npm http GET https://registry.npmjs.org/get-urls
npm http GET https://registry.npmjs.org/decompress
npm http GET https://registry.npmjs.org/nopt
npm http GET https://registry.npmjs.org/mkdirp
npm http GET https://registry.npmjs.org/request
npm http GET https://registry.npmjs.org/through2
npm http GET https://registry.npmjs.org/mkdirp
npm http 304 https://registry.npmjs.org/nopt
npm http 304 https://registry.npmjs.org/get-urls
npm http 304 https://registry.npmjs.org/get-stdin
npm http 304 https://registry.npmjs.org/decompress
npm http 304 https://registry.npmjs.org/each-async
npm http GET https://registry.npmjs.org/request
npm http GET https://registry.npmjs.org/htmlparser2
npm http GET https://registry.npmjs.org/nwmatcher
npm http GET https://registry.npmjs.org/xmlhttprequest
npm http GET https://registry.npmjs.org/cssom
npm http GET https://registry.npmjs.org/cssstyle
npm http GET https://registry.npmjs.org/contextify
npm http GET https://registry.npmjs.org/tiny-jsonrpc
npm http GET https://registry.npmjs.org/underscore
npm http GET https://registry.npmjs.org/async
npm http GET https://registry.npmjs.org/carrier
npm http GET https://registry.npmjs.org/readable-stream
npm http GET https://registry.npmjs.org/duplexer
npm http 200 https://registry.npmjs.org/mkdirp
npm http 200 https://registry.npmjs.org/mkdirp
npm http 304 https://registry.npmjs.org/through2
npm http GET https://registry.npmjs.org/cycle
npm http GET https://registry.npmjs.org/colors
npm http GET https://registry.npmjs.org/eyes
npm http GET https://registry.npmjs.org/pkginfo
npm http GET https://registry.npmjs.org/stack-trace
npm http GET https://registry.npmjs.org/async
npm http GET https://registry.npmjs.org/request
npm http GET https://registry.npmjs.org/nwmatcher
npm http 200 https://registry.npmjs.org/request
npm http 304 https://registry.npmjs.org/htmlparser2
npm http 304 https://registry.npmjs.org/nwmatcher
npm http 304 https://registry.npmjs.org/xmlhttprequest
npm http 304 https://registry.npmjs.org/cssom
npm http 304 https://registry.npmjs.org/cssstyle
npm http 304 https://registry.npmjs.org/contextify
npm http 304 https://registry.npmjs.org/tiny-jsonrpc
npm http 304 https://registry.npmjs.org/carrier

> sleep@1.1.5 install /usr/local/lib/node_modules/quickscrape/node_modules/sleep
> node build.js || nodejs build.js

gyp WARN EACCES user "root" does not have permission to access the dev dir "/Users/pm286/.node-gyp/0.10.28"
gyp WARN EACCES attempting to reinstall using temporary dev dir "/usr/local/lib/node_modules/quickscrape/node_modules/sleep/.node-gyp"
gyp http GET http://nodejs.org/dist/v0.10.28/node-v0.10.28.tar.gz
gyp http 200 http://nodejs.org/dist/v0.10.28/node-v0.10.28.tar.gz
gyp WARN install got an error, rolling back install
gyp http GET http://nodejs.org/dist/v0.10.28/SHASUMS.txt
gyp http GET http://nodejs.org/dist/v0.10.28/SHASUMS.txt
gyp WARN install got an error, rolling back install
gyp ERR! configure error 
gyp ERR! stack Error: unexpected eof
gyp ERR! stack     at decorate (/usr/local/lib/node_modules/npm/node_modules/fstream/lib/abstract.js:67:36)
gyp ERR! stack     at Extract.Abstract.error (/usr/local/lib/node_modules/npm/node_modules/fstream/lib/abstract.js:61:12)
gyp ERR! stack     at Extract._streamEnd (/usr/local/lib/node_modules/npm/node_modules/tar/lib/extract.js:75:22)
gyp ERR! stack     at BlockStream.<anonymous> (/usr/local/lib/node_modules/npm/node_modules/tar/lib/parse.js:50:8)
gyp ERR! stack     at BlockStream.EventEmitter.emit (events.js:92:17)
gyp ERR! stack     at BlockStream._emitChunk (/usr/local/lib/node_modules/npm/node_modules/block-stream/block-stream.js:203:10)
gyp ERR! stack     at BlockStream.resume (/usr/local/lib/node_modules/npm/node_modules/block-stream/block-stream.js:58:15)
gyp ERR! stack     at Extract.Reader.resume (/usr/local/lib/node_modules/npm/node_modules/fstream/lib/reader.js:253:34)
gyp ERR! stack     at DirWriter.ondrain (stream.js:61:14)
gyp ERR! stack     at DirWriter.EventEmitter.emit (events.js:92:17)
gyp ERR! System Darwin 13.2.0
gyp ERR! command "node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild" "--global" "quickscrape"
gyp ERR! cwd /usr/local/lib/node_modules/quickscrape/node_modules/sleep
gyp ERR! node -v v0.10.28
gyp ERR! node-gyp -v v0.13.0
gyp ERR! not ok 
[sleep]: Error: Failed to execute 'node-gyp rebuild --global quickscrape' (1)
sh: nodejs: command not found
npm http 200 https://registry.npmjs.org/underscore
npm http 304 https://registry.npmjs.org/readable-stream
npm http 304 https://registry.npmjs.org/duplexer
npm http GET https://registry.npmjs.org/adm-zip
npm http GET https://registry.npmjs.org/extname
npm http GET https://registry.npmjs.org/map-key
npm http GET https://registry.npmjs.org/rimraf
npm http GET https://registry.npmjs.org/stream-combiner
npm http GET https://registry.npmjs.org/tempfile
npm http GET https://registry.npmjs.org/tar
npm http GET https://registry.npmjs.org/xtend
npm http GET https://registry.npmjs.org/abbrev
npm http GET https://registry.npmjs.org/mime
npm http GET https://registry.npmjs.org/node-uuid
npm http GET https://registry.npmjs.org/forever-agent
npm http GET https://registry.npmjs.org/tunnel-agent
npm http GET https://registry.npmjs.org/tough-cookie
npm http GET https://registry.npmjs.org/form-data
npm http GET https://registry.npmjs.org/oauth-sign
npm http GET https://registry.npmjs.org/http-signature
npm http GET https://registry.npmjs.org/hawk
npm http GET https://registry.npmjs.org/aws-sign2
npm http GET https://registry.npmjs.org/json-stringify-safe
npm http GET https://registry.npmjs.org/qs
npm http 200 https://registry.npmjs.org/colors
npm http GET https://registry.npmjs.org/colors/-/colors-0.6.2.tgz
npm http 200 https://registry.npmjs.org/cycle
npm http GET https://registry.npmjs.org/cycle/-/cycle-1.0.3.tgz
npm http 200 https://registry.npmjs.org/eyes
npm http GET https://registry.npmjs.org/eyes/-/eyes-0.1.8.tgz
npm http 200 https://registry.npmjs.org/async
npm http 200 https://registry.npmjs.org/request
npm http 200 https://registry.npmjs.org/pkginfo
npm http GET https://registry.npmjs.org/pkginfo/-/pkginfo-0.3.0.tgz
npm http 200 https://registry.npmjs.org/stack-trace
npm http GET https://registry.npmjs.org/stack-trace/-/stack-trace-0.0.9.tgz
npm http 200 https://registry.npmjs.org/cycle/-/cycle-1.0.3.tgz
npm http GET https://registry.npmjs.org/bindings
npm http GET https://registry.npmjs.org/nan
npm http 200 https://registry.npmjs.org/eyes/-/eyes-0.1.8.tgz
npm http GET https://registry.npmjs.org/string_decoder
npm http GET https://registry.npmjs.org/core-util-is
npm http GET https://registry.npmjs.org/isarray
npm http GET https://registry.npmjs.org/inherits
npm http 200 https://registry.npmjs.org/colors/-/colors-0.6.2.tgz
npm http 304 https://registry.npmjs.org/extname
npm http 304 https://registry.npmjs.org/adm-zip
npm http 304 https://registry.npmjs.org/nwmatcher
npm http 304 https://registry.npmjs.org/rimraf
npm http 200 https://registry.npmjs.org/stream-combiner
npm http 304 https://registry.npmjs.org/map-key
npm http 200 https://registry.npmjs.org/pkginfo/-/pkginfo-0.3.0.tgz
npm http GET https://registry.npmjs.org/domutils
npm http GET https://registry.npmjs.org/domelementtype
npm http GET https://registry.npmjs.org/domhandler
npm http GET https://registry.npmjs.org/entities
npm http 304 https://registry.npmjs.org/tempfile
npm http 304 https://registry.npmjs.org/xtend
npm http 200 https://registry.npmjs.org/request
npm http GET https://registry.npmjs.org/request/-/request-2.16.6.tgz
npm http 200 https://registry.npmjs.org/stack-trace/-/stack-trace-0.0.9.tgz
npm http GET https://registry.npmjs.org/object-keys
npm http 304 https://registry.npmjs.org/abbrev
npm http 200 https://registry.npmjs.org/async
npm http 200 https://registry.npmjs.org/tar
npm http 200 https://registry.npmjs.org/mime
npm http 200 https://registry.npmjs.org/node-uuid
npm http 304 https://registry.npmjs.org/forever-agent
npm http 304 https://registry.npmjs.org/tunnel-agent
npm http 304 https://registry.npmjs.org/tough-cookie
npm http 304 https://registry.npmjs.org/form-data
npm http GET https://registry.npmjs.org/uuid
npm http 200 https://registry.npmjs.org/request/-/request-2.16.6.tgz
npm http GET https://registry.npmjs.org/lodash
npm http GET https://registry.npmjs.org/underscore.string
npm http 304 https://registry.npmjs.org/oauth-sign
npm http 304 https://registry.npmjs.org/http-signature
npm http 304 https://registry.npmjs.org/aws-sign2
npm http 304 https://registry.npmjs.org/hawk
npm http 304 https://registry.npmjs.org/json-stringify-safe
npm http GET https://registry.npmjs.org/ext-list
npm http GET https://registry.npmjs.org/underscore.string
npm http 304 https://registry.npmjs.org/qs
npm http 304 https://registry.npmjs.org/core-util-is
npm http 304 https://registry.npmjs.org/string_decoder
npm http 304 https://registry.npmjs.org/bindings
npm http 200 https://registry.npmjs.org/inherits
npm http 304 https://registry.npmjs.org/domutils
npm http 304 https://registry.npmjs.org/domelementtype
npm http 304 https://registry.npmjs.org/isarray
npm http 200 https://registry.npmjs.org/nan
npm http 304 https://registry.npmjs.org/entities
npm http 304 https://registry.npmjs.org/domhandler
npm http 304 https://registry.npmjs.org/underscore.string
npm http 304 https://registry.npmjs.org/underscore.string
npm http 304 https://registry.npmjs.org/object-keys
npm http 200 https://registry.npmjs.org/uuid
npm http 304 https://registry.npmjs.org/ext-list
npm http 200 https://registry.npmjs.org/lodash
npm http GET https://registry.npmjs.org/combined-stream
npm http GET https://registry.npmjs.org/assert-plus
npm http GET https://registry.npmjs.org/asn1
npm http GET https://registry.npmjs.org/ctype
npm http GET https://registry.npmjs.org/block-stream
npm http GET https://registry.npmjs.org/fstream
npm http GET https://registry.npmjs.org/punycode
npm http GET https://registry.npmjs.org/cryptiles
npm http GET https://registry.npmjs.org/hoek
npm http GET https://registry.npmjs.org/boom
npm http GET https://registry.npmjs.org/sntp
npm http GET https://registry.npmjs.org/cookie-jar
npm http GET https://registry.npmjs.org/aws-sign
npm http GET https://registry.npmjs.org/form-data/-/form-data-0.0.10.tgz
npm http GET https://registry.npmjs.org/hawk/-/hawk-0.10.2.tgz
npm http GET https://registry.npmjs.org/oauth-sign/-/oauth-sign-0.2.0.tgz
npm http GET https://registry.npmjs.org/forever-agent/-/forever-agent-0.2.0.tgz
npm http GET https://registry.npmjs.org/tunnel-agent/-/tunnel-agent-0.2.0.tgz
npm http GET https://registry.npmjs.org/json-stringify-safe/-/json-stringify-safe-3.0.0.tgz
npm http GET https://registry.npmjs.org/qs/-/qs-0.5.6.tgz
npm http 304 https://registry.npmjs.org/assert-plus
npm http 200 https://registry.npmjs.org/hawk/-/hawk-0.10.2.tgz
npm http 200 https://registry.npmjs.org/forever-agent/-/forever-agent-0.2.0.tgz
npm http 200 https://registry.npmjs.org/form-data/-/form-data-0.0.10.tgz
npm http 304 https://registry.npmjs.org/fstream
npm http 304 https://registry.npmjs.org/block-stream
npm http 200 https://registry.npmjs.org/oauth-sign/-/oauth-sign-0.2.0.tgz
npm http 200 https://registry.npmjs.org/json-stringify-safe/-/json-stringify-safe-3.0.0.tgz
npm http 200 https://registry.npmjs.org/qs/-/qs-0.5.6.tgz
npm http GET https://registry.npmjs.org/graceful-fs
npm http 200 https://registry.npmjs.org/tunnel-agent/-/tunnel-agent-0.2.0.tgz
npm http 304 https://registry.npmjs.org/asn1
npm http 304 https://registry.npmjs.org/punycode
npm http 304 https://registry.npmjs.org/ctype
npm http 304 https://registry.npmjs.org/cryptiles
npm http 200 https://registry.npmjs.org/cookie-jar
npm http GET https://registry.npmjs.org/cookie-jar/-/cookie-jar-0.2.0.tgz
npm http 304 https://registry.npmjs.org/sntp
npm http 304 https://registry.npmjs.org/boom
npm http 304 https://registry.npmjs.org/graceful-fs
npm http 200 https://registry.npmjs.org/aws-sign
npm http GET https://registry.npmjs.org/aws-sign/-/aws-sign-0.2.0.tgz
npm http 200 https://registry.npmjs.org/cookie-jar/-/cookie-jar-0.2.0.tgz
npm http 200 https://registry.npmjs.org/aws-sign/-/aws-sign-0.2.0.tgz
npm WARN engine hawk@0.10.2: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"})
npm http 200 https://registry.npmjs.org/hoek
npm http GET https://registry.npmjs.org/hoek/-/hoek-0.7.6.tgz
npm http GET https://registry.npmjs.org/boom/-/boom-0.3.8.tgz
npm http GET https://registry.npmjs.org/cryptiles/-/cryptiles-0.1.3.tgz
npm http GET https://registry.npmjs.org/sntp/-/sntp-0.1.4.tgz
npm http 200 https://registry.npmjs.org/sntp/-/sntp-0.1.4.tgz
npm http 200 https://registry.npmjs.org/hoek/-/hoek-0.7.6.tgz
npm http 200 https://registry.npmjs.org/boom/-/boom-0.3.8.tgz
npm http 304 https://registry.npmjs.org/combined-stream
npm http 200 https://registry.npmjs.org/cryptiles/-/cryptiles-0.1.3.tgz
npm http GET https://registry.npmjs.org/delayed-stream
npm WARN engine sntp@0.1.4: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"})
npm WARN engine cryptiles@0.1.3: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"})
npm WARN engine hoek@0.7.6: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"})
npm WARN engine boom@0.3.8: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"})
npm http 304 https://registry.npmjs.org/delayed-stream

> contextify@0.1.8 install /usr/local/lib/node_modules/quickscrape/node_modules/jsdom/node_modules/contextify
> node-gyp rebuild

gyp ERR! UNCAUGHT EXCEPTION 
gyp ERR! stack Error: ENOENT, no such file or directory
gyp ERR! stack     at process.cwd (/usr/local/lib/node_modules/npm/node_modules/graceful-fs/polyfills.js:8:19)
gyp ERR! stack     at Object.exports.resolve (path.js:309:52)
gyp ERR! stack     at configure (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:26:23)
gyp ERR! stack     at Object.self.commands.(anonymous function) [as configure] (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/node-gyp.js:66:37)
gyp ERR! stack     at run (/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js:72:30)
gyp ERR! stack     at process._tickCallback (node.js:419:13)
gyp ERR! System Darwin 13.2.0
gyp ERR! command "node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"

/usr/local/lib/node_modules/npm/node_modules/graceful-fs/polyfills.js:8
    cwd = origCwd.call(process)
                  ^
Error: ENOENT, no such file or directory
    at process.cwd (/usr/local/lib/node_modules/npm/node_modules/graceful-fs/polyfills.js:8:19)
    at errorMessage (/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js:119:28)
    at issueMessage (/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js:125:3)
    at process.<anonymous> (/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js:109:3)
    at process.EventEmitter.emit (events.js:95:17)
    at process._fatalException (node.js:272:26)

> contextify@0.1.8 install /usr/local/lib/node_modules/quickscrape/node_modules/jsdom-xpath/node_modules/jsdom/node_modules/contextify
> node-gyp rebuild

node.js:815
    var cwd = process.cwd();
                      ^
Error: ENOENT, no such file or directory
    at Function.startup.resolveArgv0 (node.js:815:23)
    at startup (node.js:58:13)
    at node.js:906:3
npm ERR! sleep@1.1.5 install: `node build.js || nodejs build.js`
npm ERR! Exit status 127
npm ERR! 
npm ERR! Failed at the sleep@1.1.5 install script.
npm ERR! This is most likely a problem with the sleep package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     node build.js || nodejs build.js
npm ERR! You can get their info via:
npm ERR!     npm owner ls sleep
npm ERR! There is likely additional logging output above.
npm ERR! System Darwin 13.2.0
npm ERR! command "node" "/usr/local/bin/npm" "install" "--global" "quickscrape"
npm ERR! cwd /Users/pm286/workspace/quickscrape
npm ERR! node -v v0.10.28
npm ERR! npm -v 1.4.9
npm ERR! code ELIFECYCLE
npm ERR! 
npm ERR! Additional logging details can be found in:
npm ERR!     /Users/pm286/workspace/quickscrape/npm-debug.log
npm ERR! not ok code 0
okapi:quickscrape pm286$ 
blahah commented 10 years ago

@petermr seems like a problem with the nodejs installation. Can you post the output of the following:

petermr commented 10 years ago

node --version v0.10.28 okapi:quickscrape pm286$ nodejs -bash: nodejs: command not found okapi:quickscrape pm286$ ls -alh /Users/pm286/.node-gyp/ ls: /Users/pm286/.node-gyp/: No such file or directory okapi:quickscrape pm286$

On Sat, May 31, 2014 at 1:57 PM, Richard Smith-Unna < notifications@github.com> wrote:

@petermr https://github.com/petermr seems like a problem with the nodejs installation. Can you post the output of the following:

  • node --version
  • nodejs
  • ls -alh /Users/pm286/.node-gyp/

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44746384 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

blahah commented 10 years ago

OK, the problem is caused by a dependency we're actually not using anymore. I'll remove them from the next version and ping you when it gets pushed (in the next couple of hours).

petermr commented 10 years ago

Brill, (spent a day writing the same library as I did 5 years ago! Happy to test your stuff)

On Sat, May 31, 2014 at 2:56 PM, Richard Smith-Unna < notifications@github.com> wrote:

OK, the problem is caused by a dependency we're actually not using anymore. I'll remove them from the next version and ping you when it gets pushed (in the next couple of hours).

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44747607 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

blahah commented 10 years ago

You spent a day writing or I did? It's a shame how often things don't get reused.

In this case I've leant very heavily on existing Node.js packages, but in the stuff I've written from scratch there's necessarily some duplication from existing scrapers. The problem is that it's harder to use what they've created than to write it from scratch. And if I write it myself, I can document and test it properly (the fact that others don't do this is part of why I rewrote).

petermr commented 10 years ago

Sorry - nothing to do with you :-) I spent a day on train writing my OCR stuff and creating a library which I then found I had already written! No harm, just I could have gone further...

On Sat, May 31, 2014 at 3:35 PM, Richard Smith-Unna < notifications@github.com> wrote:

You spent a day writing or I did? It's a shame how often things don't get reused.

In this case I've leant very heavily on existing Node.js packages, but in the stuff I've written from scratch there's necessarily some duplication from existing scrapers. The problem is that it's harder to use what they've created than to write it from scratch. And if I write it myself, I can document and test it properly (the fact that others don't do this is part of why I rewrote).

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44748477 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

blahah commented 10 years ago

Haha yeah I do that frequently too. Good for exercising the creative brain, if not the memory!

blahah commented 10 years ago

OK, I've pushed version 0.1.4. Please try again (sudo npm install --global quickscrape), and see the README on the project homepage for updated usage instructions.

petermr commented 10 years ago

Message received - am hacking it. (Wifi very slow here)

Thanks

On Sat, May 31, 2014 at 9:29 PM, Richard Smith-Unna < notifications@github.com> wrote:

OK, I've pushed version 0.1.4. Please try again (sudo npm install --global quickscrape), and see the README on the project homepage for updated usage instructions.

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44757341 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

petermr commented 10 years ago

Afraid it failed again. Will post to issues hopefully

On Sat, May 31, 2014 at 9:55 PM, Peter Murray-Rust pm286@cam.ac.uk wrote:

Message received - am hacking it. (Wifi very slow here)

Thanks

On Sat, May 31, 2014 at 9:29 PM, Richard Smith-Unna < notifications@github.com> wrote:

OK, I've pushed version 0.1.4. Please try again (sudo npm install --global quickscrape), and see the README on the project homepage for updated usage instructions.

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44757341 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

petermr commented 10 years ago

okapi:quickscrape pm286$ sudo npm install --global quickscrape Password: npm http GET https://registry.npmjs.org/quickscrape npm http 200 https://registry.npmjs.org/quickscrape npm http GET https://registry.npmjs.org/quickscrape/-/quickscrape-0.1.4.tgz npm http 200 https://registry.npmjs.org/quickscrape/-/quickscrape-0.1.4.tgz npm http GET https://registry.npmjs.org/commander npm http GET https://registry.npmjs.org/spooky npm http GET https://registry.npmjs.org/download npm http GET https://registry.npmjs.org/xpath npm http GET https://registry.npmjs.org/jsdom npm http GET https://registry.npmjs.org/winston npm http GET https://registry.npmjs.org/which npm http 304 https://registry.npmjs.org/download npm http 304 https://registry.npmjs.org/jsdom npm http 304 https://registry.npmjs.org/spooky npm http 304 https://registry.npmjs.org/xpath npm http 304 https://registry.npmjs.org/commander npm http 304 https://registry.npmjs.org/which npm http 304 https://registry.npmjs.org/winston npm http GET https://registry.npmjs.org/decompress npm http GET https://registry.npmjs.org/each-async npm http GET https://registry.npmjs.org/get-stdin npm http GET https://registry.npmjs.org/get-urls npm http GET https://registry.npmjs.org/mkdirp npm http GET https://registry.npmjs.org/nopt npm http GET https://registry.npmjs.org/request npm http GET https://registry.npmjs.org/through2 npm http GET https://registry.npmjs.org/htmlparser2 npm http GET https://registry.npmjs.org/request npm http GET https://registry.npmjs.org/nwmatcher npm http GET https://registry.npmjs.org/xmlhttprequest npm http GET https://registry.npmjs.org/cssom npm http GET https://registry.npmjs.org/cssstyle npm http GET https://registry.npmjs.org/contextify npm http GET https://registry.npmjs.org/underscore npm http GET https://registry.npmjs.org/async npm http GET https://registry.npmjs.org/tiny-jsonrpc npm http GET https://registry.npmjs.org/carrier npm http GET https://registry.npmjs.org/duplexer npm http GET https://registry.npmjs.org/readable-stream npm http 304 https://registry.npmjs.org/decompress npm http GET https://registry.npmjs.org/async npm http GET https://registry.npmjs.org/colors npm http GET https://registry.npmjs.org/cycle npm http GET https://registry.npmjs.org/eyes npm http GET https://registry.npmjs.org/pkginfo npm http GET https://registry.npmjs.org/request npm http GET https://registry.npmjs.org/stack-trace npm http 304 https://registry.npmjs.org/nopt npm http 304 https://registry.npmjs.org/get-urls npm http 304 https://registry.npmjs.org/request npm http 304 https://registry.npmjs.org/each-async npm http 304 https://registry.npmjs.org/mkdirp npm http 304 https://registry.npmjs.org/request npm http 304 https://registry.npmjs.org/through2 npm http 304 https://registry.npmjs.org/get-stdin npm http 304 https://registry.npmjs.org/htmlparser2 npm http 304 https://registry.npmjs.org/nwmatcher npm http 304 https://registry.npmjs.org/xmlhttprequest npm http 304 https://registry.npmjs.org/cssom npm http 304 https://registry.npmjs.org/underscore npm http 304 https://registry.npmjs.org/async npm http 304 https://registry.npmjs.org/contextify npm http GET https://registry.npmjs.org/adm-zip npm http GET https://registry.npmjs.org/extname npm http GET https://registry.npmjs.org/rimraf npm http GET https://registry.npmjs.org/stream-combiner npm http GET https://registry.npmjs.org/tar npm http GET https://registry.npmjs.org/tempfile npm http GET https://registry.npmjs.org/map-key npm http 304 https://registry.npmjs.org/cssstyle npm http GET https://registry.npmjs.org/readable-stream npm http GET https://registry.npmjs.org/xtend npm http 304 https://registry.npmjs.org/duplexer npm http GET https://registry.npmjs.org/abbrev npm http 304 https://registry.npmjs.org/async npm http 304 https://registry.npmjs.org/readable-stream npm http 304 https://registry.npmjs.org/carrier npm http 304 https://registry.npmjs.org/tiny-jsonrpc npm http 304 https://registry.npmjs.org/request npm http 304 https://registry.npmjs.org/eyes npm http 304 https://registry.npmjs.org/colors npm http 304 https://registry.npmjs.org/pkginfo npm http 304 https://registry.npmjs.org/cycle npm http GET https://registry.npmjs.org/qs npm http GET https://registry.npmjs.org/json-stringify-safe npm http GET https://registry.npmjs.org/forever-agent npm http GET https://registry.npmjs.org/mime npm http GET https://registry.npmjs.org/node-uuid npm http GET https://registry.npmjs.org/tough-cookie npm http GET https://registry.npmjs.org/form-data npm http 304 https://registry.npmjs.org/extname npm http 304 https://registry.npmjs.org/rimraf npm http GET https://registry.npmjs.org/tunnel-agent npm http GET https://registry.npmjs.org/http-signature npm http GET https://registry.npmjs.org/oauth-sign npm http GET https://registry.npmjs.org/hawk npm http GET https://registry.npmjs.org/aws-sign2 npm http 304 https://registry.npmjs.org/adm-zip npm http 304 https://registry.npmjs.org/stream-combiner npm http 304 https://registry.npmjs.org/readable-stream npm http 304 https://registry.npmjs.org/tempfile npm http 304 https://registry.npmjs.org/tar npm http 304 https://registry.npmjs.org/stack-trace npm http 304 https://registry.npmjs.org/map-key npm http GET https://registry.npmjs.org/bindings npm http GET https://registry.npmjs.org/nan npm http 304 https://registry.npmjs.org/xtend npm http 304 https://registry.npmjs.org/abbrev npm http 304 https://registry.npmjs.org/json-stringify-safe npm http 304 https://registry.npmjs.org/forever-agent npm http 304 https://registry.npmjs.org/mime npm http 304 https://registry.npmjs.org/node-uuid npm http 304 https://registry.npmjs.org/tough-cookie npm http 304 https://registry.npmjs.org/qs npm http 304 https://registry.npmjs.org/tunnel-agent npm http 304 https://registry.npmjs.org/http-signature npm http 304 https://registry.npmjs.org/oauth-sign npm http 304 https://registry.npmjs.org/form-data npm http 304 https://registry.npmjs.org/hawk npm http GET https://registry.npmjs.org/uuid npm http GET https://registry.npmjs.org/lodash npm http GET https://registry.npmjs.org/underscore.string npm http GET https://registry.npmjs.org/underscore.string npm http GET https://registry.npmjs.org/ext-list npm http 304 https://registry.npmjs.org/aws-sign2 npm http 304 https://registry.npmjs.org/nan npm http 304 https://registry.npmjs.org/bindings npm http GET https://registry.npmjs.org/inherits npm http GET https://registry.npmjs.org/core-util-is npm http GET https://registry.npmjs.org/isarray npm http GET https://registry.npmjs.org/string_decoder npm http 304 https://registry.npmjs.org/underscore.string npm http 304 https://registry.npmjs.org/lodash npm http 304 https://registry.npmjs.org/ext-list npm http 304 https://registry.npmjs.org/inherits npm http 304 https://registry.npmjs.org/isarray npm http 304 https://registry.npmjs.org/uuid npm http GET https://registry.npmjs.org/object-keys npm http 304 https://registry.npmjs.org/core-util-is npm http 304 https://registry.npmjs.org/string_decoder npm http 304 https://registry.npmjs.org/underscore.string npm http 304 https://registry.npmjs.org/object-keys npm http GET https://registry.npmjs.org/combined-stream npm http GET https://registry.npmjs.org/assert-plus npm http GET https://registry.npmjs.org/asn1 npm http GET https://registry.npmjs.org/ctype

contextify@0.1.8 install /usr/local/lib/node_modules/quickscrape/node_modules/jsdom/node_modules/contextify node-gyp rebuild

gyp WARN EACCES user "root" does not have permission to access the dev dir "/Users/pm286/.node-gyp/0.10.28" gyp WARN EACCES attempting to reinstall using temporary dev dir "/usr/local/lib/node_modules/quickscrape/node_modules/jsdom/node_modules/contextify/.node-gyp" gyp http GET http://nodejs.org/dist/v0.10.28/node-v0.10.28.tar.gz gyp http 200 http://nodejs.org/dist/v0.10.28/node-v0.10.28.tar.gz

gyp ERR! Completion callback never invoked! gyp ERR! System Darwin 13.2.0 gyp ERR! command "node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild" gyp ERR! cwd /usr/local/lib/node_modules/quickscrape/node_modules/jsdom/node_modules/contextify gyp ERR! node -v v0.10.28 gyp ERR! node-gyp -v v0.13.0 gyp ERR! This is a bug in node-gyp. gyp ERR! Try to update node-gyp and file an Issue if it does not help: gyp ERR! https://github.com/TooTallNate/node-gyp/issues npm http 304 https://registry.npmjs.org/asn1 npm http 304 https://registry.npmjs.org/assert-plus npm http 304 https://registry.npmjs.org/ctype npm http GET https://registry.npmjs.org/fstream npm http GET https://registry.npmjs.org/block-stream npm http GET https://registry.npmjs.org/domhandler npm http GET https://registry.npmjs.org/domutils npm http GET https://registry.npmjs.org/domelementtype npm http GET https://registry.npmjs.org/entities npm http 304 https://registry.npmjs.org/combined-stream npm http GET https://registry.npmjs.org/punycode npm http GET https://registry.npmjs.org/cookie-jar npm http GET https://registry.npmjs.org/aws-sign npm http 304 https://registry.npmjs.org/block-stream npm http 304 https://registry.npmjs.org/domelementtype npm http GET https://registry.npmjs.org/hoek npm http GET https://registry.npmjs.org/boom npm http GET https://registry.npmjs.org/cryptiles npm http GET https://registry.npmjs.org/sntp npm http 304 https://registry.npmjs.org/fstream npm http 304 https://registry.npmjs.org/domhandler npm http 304 https://registry.npmjs.org/domutils npm http 304 https://registry.npmjs.org/punycode npm http 304 https://registry.npmjs.org/aws-sign npm http 304 https://registry.npmjs.org/cookie-jar npm http 304 https://registry.npmjs.org/hoek npm http GET https://registry.npmjs.org/delayed-stream npm http 304 https://registry.npmjs.org/boom npm http 304 https://registry.npmjs.org/cryptiles npm http 304 https://registry.npmjs.org/sntp npm WARN engine hawk@0.10.2: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"}) npm http 304 https://registry.npmjs.org/entities npm http 304 https://registry.npmjs.org/delayed-stream npm http GET https://registry.npmjs.org/graceful-fs npm http 304 https://registry.npmjs.org/graceful-fs npm WARN engine hoek@0.7.6: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"}) npm WARN engine boom@0.3.8: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"}) npm WARN engine cryptiles@0.1.3: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"}) npm WARN engine sntp@0.1.4: wanted: {"node":"0.8.x"} (current: {"node":"v0.10.28","npm":"1.4.9"}) npm ERR! contextify@0.1.8 install: node-gyp rebuild npm ERR! Exit status 6 npm ERR! npm ERR! Failed at the contextify@0.1.8 install script. npm ERR! This is most likely a problem with the contextify package, npm ERR! not with npm itself. npm ERR! Tell the author that this fails on your system: npm ERR! node-gyp rebuild npm ERR! You can get their info via: npm ERR! npm owner ls contextify npm ERR! There is likely additional logging output above.

npm ERR! System Darwin 13.2.0 npm ERR! command "node" "/usr/local/bin/npm" "install" "--global" "quickscrape" npm ERR! cwd /Users/pm286/workspace/quickscrape npm ERR! node -v v0.10.28 npm ERR! npm -v 1.4.9 npm ERR! code ELIFECYCLE npm ERR! npm ERR! Additional logging details can be found in: npm ERR! /Users/pm286/workspace/quickscrape/npm-debug.log npm ERR! not ok code 0

petermr commented 10 years ago

should I create a ./node-gyp directory?

blahah commented 10 years ago

Not sure what's going on there yet, can you post contents of /Users/pm286/workspace/quickscrape/npm-debug.log?

blahah commented 10 years ago

also can you try sudo npm install --global --unsafe-perm quickscrape?

There appears to be a known bug that causes something similar to this: https://github.com/TooTallNate/node-gyp/issues/115#issuecomment-28490552

blahah commented 10 years ago

final thing to try is:

env SUDO_UID= SUDO_USER= npm i
sudo npm install --global quckscrape
petermr commented 10 years ago

Many Thanks Richard,

Will do those things now.

Questions:

P.

On Sun, Jun 1, 2014 at 12:54 AM, Richard Smith-Unna < notifications@github.com> wrote:

Not sure what's going on there yet, can you post contents of /Users/pm286/workspace/quickscrape/npm-debug.log?

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44762511 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

petermr commented 10 years ago

Richard, It's 2 MB so I have mailed it - hope that OK.

Suggest we get Ross and Mark to try it.

On Sun, Jun 1, 2014 at 8:45 AM, Peter Murray-Rust pm286@cam.ac.uk wrote:

Many Thanks Richard,

Will do those things now.

Questions:

  • is this a Mac OSX issue or generally? i.e. can we kludge round by finding "pure" unix people in each group. (I am assuming it worksForYou; maybe get MarkM and Ross to beta test ...
  • shall I reinstall from scratch? If so suggest you give the complete list of commands , possibly including an initial "clean"

P.

On Sun, Jun 1, 2014 at 12:54 AM, Richard Smith-Unna < notifications@github.com> wrote:

Not sure what's going on there yet, can you post contents of /Users/pm286/workspace/quickscrape/npm-debug.log?

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44762511 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

petermr commented 10 years ago

PROGRESS!

Seems to not fail. tail of console:

/usr/local/bin/quickscrape -> /usr/local/lib/node_modules/quickscrape/bin/quickscrape.js

quickscrape@0.1.4 /usr/local/lib/node_modules/quickscrape

├── which@1.0.5

├── commander@2.2.0

├── xpath@0.0.6

├── spooky@0.2.4 (duplexer@0.0.4, carrier@0.1.14, async@0.1.22, underscore@1.3.3, tiny-jsonrpc@0.2.1, readable-stream@1.0.27-1)

├── winston@0.7.3 (cycle@1.0.3, stack-trace@0.0.9, eyes@0.1.8, colors@0.6.2, async@0.2.10, pkginfo@0.3.0, request@2.16.6)

├── download@0.1.17 (get-stdin@0.1.0, each-async@0.1.3, get-urls@0.1.2, mkdirp@0.3.5, nopt@2.2.1, through2@0.4.2, decompress@0.2.3, request@2.36.0)

└── jsdom@0.10.6 (xmlhttprequest@1.6.0, cssom@0.3.0, nwmatcher@1.3.3, htmlparser2@3.7.2, cssstyle@0.2.14, request@2.36.0, contextify@0.1.8)

okapi:quickscrape pm286$

Will try to run it and get back to you..

VERY much appreciated

On Sun, Jun 1, 2014 at 8:56 AM, Peter Murray-Rust pm286@cam.ac.uk wrote:

Richard, It's 2 MB so I have mailed it - hope that OK.

Suggest we get Ross and Mark to try it.

On Sun, Jun 1, 2014 at 8:45 AM, Peter Murray-Rust pm286@cam.ac.uk wrote:

Many Thanks Richard,

Will do those things now.

Questions:

  • is this a Mac OSX issue or generally? i.e. can we kludge round by finding "pure" unix people in each group. (I am assuming it worksForYou; maybe get MarkM and Ross to beta test ...
  • shall I reinstall from scratch? If so suggest you give the complete list of commands , possibly including an initial "clean"

P.

On Sun, Jun 1, 2014 at 12:54 AM, Richard Smith-Unna < notifications@github.com> wrote:

Not sure what's going on there yet, can you post contents of /Users/pm286/workspace/quickscrape/npm-debug.log?

— Reply to this email directly or view it on GitHub https://github.com/ContentMine/quickscrape/issues/1#issuecomment-44762511 .

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

Peter Murray-Rust Reader in Molecular Informatics Unilever Centre, Dep. Of Chemistry University of Cambridge CB2 1EW, UK +44-1223-763069

blahah commented 10 years ago

Looks like that has worked. Not clear to me yet whether it's OSX specific.

blahah commented 10 years ago

It's not OSX-specific, but the --unsafe-perms flag fixes it for now. We'll have to update as the the package manager gets fixed, but I'll close it in the meantime.