Closed rossmounce closed 9 years ago
Just to clarify it was nodejs that crashed. Apport caught the crash. I'd send the .crash file only it's 260MB's!
is the .crash a text file? If so can you tail -1000
on it and send me that?
plaintext. Lots of garbage until the last 35 lines:
ZuEGNyUzY+elJyYjpeLCcEiZFvZDkNmFvk90sCt/XuUuy/3pv5++kyb5zJuo40c8WTv93K/r9gajvl4n1gwjRfeI0Gk8Sb4mJ6bGdo09KSm8jup+Tvr/zYpG2tzNP5E7Rl1Ki36iqRPUdMURP57/qlkPpqkmSYDRi5TUvizaQFLOfIDkScRgHEN1xxO3pHNx2Xrp3/qt0/hIt+MMZ06Zl6pNLpbMb/djUjNTRKekT6FFO+ihaIAipzTXNjiaHbYGQWiM+NUutXNLQvKSexo4mIbW6oSW1tapJOmZRZ8orhdSGRkeVkFpVU76wyVZfVV5T2aTkJAq2+toKIbWpUXyAR7Z7C1qqy0lTdWJlbXOFrYnQsNU5asWWWiochGqzUlDeVGWvs1VU1Vc1OIRUR5WT/FvRWC9l+xoGwT5ey+1T9Bo8A1H2+/z5hCDQ93YGqepxH2MF/ASNcnagVeHjfma4qk69L6rRsvsgQbWXVYcRdK/QiPi473lDq5wbqPnnY/FzXSdU+Liv8kNBhhCcf0F1bjBARU85p2HPZwRObhimyftz/ryGPacJhT+bw3cBvgvw+Y0Cz/88OAPA962U8yn2XCqGw8djskpofzTky+Ioflkcqz98+ziOdRz/mwF/cxyrJ6HG3wllyF874LcD/gUR8Fdy7e8F/L2AfzAC/v1Qhvv4LfEUf0u8cj4VDn8bh4/nTPhC2wluwHQc/nOAb+DK8RzyqhDtq+NgH7geAQ29FIH/aIiGaIiGaIiGaIiGaIiGczGY3/RapccIr74VDdEQDf9lgdj//qj9R0M0/Nfa/zhN1P6jIRqiIRqiIRr+q8L/A7o/r2IAgB5y ApportVersion: 2.14.1-0ubuntu3 Dependencies: dpkg 1.17.5ubuntu5 gcc-4.8-base 4.8.2-19ubuntu1 gcc-4.9-base 4.9-20140406-0ubuntu1 libacl1 2.2.52-1 libattr1 1:2.4.47-1ubuntu1 libbz2-1.0 1.0.6-5 libc6 2.19-0ubuntu6 libgcc1 1:4.9-20140406-0ubuntu1 liblzma5 5.1.1alpha+20120614-2ubuntu2 libpcre3 1:8.31-2ubuntu2 libreadline6 6.3-4ubuntu2 libselinux1 2.2.2-1 libstdc++6 4.8.2-19ubuntu1 libtinfo5 5.9+20140118-1ubuntu1 multiarch-support 2.19-0ubuntu6 readline-common 6.3-4ubuntu2 rlwrap 0.37-5 tar 1.27.1-1 zlib1g 1:1.2.8.dfsg-1ubuntu1 InstallationDate: Installed on 2014-04-27 (42 days ago) InstallationMedia: Lubuntu 14.04 LTS "Trusty Tahr" - Release amd64 (20140416.2) Package: nodejs 0.10.28-1chl1~trusty1 [origin: LP-PPA-chris-lea-node.js] PackageArchitecture: amd64 ProcVersionSignature: Ubuntu 3.13.0-24.46-generic 3.13.9 SourcePackage: nodejs Tags: third-party-packages trusty UnreportableReason: You have some obsolete package versions installed. Please upgrade the following packages and check if the problem still occurs:
dpkg, libselinux1 UpgradeStatus: No upgrade log present (probably fresh install) _MarkForUpload: True
head -100:
ProblemType: Crash
Architecture: amd64
CurrentDesktop: LXDE
Date: Mon Jun 9 14:47:41 2014
DistroRelease: Ubuntu 14.04
ExecutablePath: /usr/bin/nodejs
ExecutableTimestamp: 1399084766
ProcCmdline: node /usr/bin/quickscrape --urllist 90.txt --scraper journal-scrapers/generic_open.json
ProcCwd: /home/ross/workspace/quickscrape/output/http_journal.frontiersin.org_Journal_10.3389_fphys.2013.00164_full
ProcEnviron:
TERM=xterm
SHELL=/bin/bash
PATH=(custom, no user)
LANG=en_GB.UTF-8
LANGUAGE=en_GB:en
XDG_RUNTIME_DIR=
Hmm, nothing in there that sheds any light, I'll try running it myself
I suspect this is to do with a known node bug: https://github.com/joyent/node/pull/3076. Best we can do is require Node >= v0.8.14 - I'll bump the requirement.
Tried scraping 90 urls from Frontiers but core dumped after ~69 of them! Not sure of the reproducibility of this bug, but I'll file it anyway...
quickscrape --urllist 90.txt --scraper journal-scrapers/generic_open.json
got stuck at: http://journal.frontiersin.org/Journal/10.3389/fphys.2013.00164/full
I can see the 'rendered.html' & the 'results.json' files but no 'full' or 'pdf' so I guess it choked somehow when attempting to get those?
tail of terminal:
The 90 URLs are here (order preserved, articles that contain the word 'phylogeny'):
http://journal.frontiersin.org/Journal/10.3389/fcimb.2012.00057/full http://journal.frontiersin.org/Journal/10.3389/fcimb.2012.00098/full http://journal.frontiersin.org/Journal/10.3389/fcimb.2012.00133/full http://journal.frontiersin.org/Journal/10.3389/fendo.2012.00131/full http://journal.frontiersin.org/Journal/10.3389/fendo.2012.00173/full http://journal.frontiersin.org/Journal/10.3389/fendo.2014.00072/full http://journal.frontiersin.org/Journal/10.3389/fevo.2013.00001/full http://journal.frontiersin.org/Journal/10.3389/fevo.2014.00011/full http://journal.frontiersin.org/Journal/10.3389/fevo.2014.00012/full http://journal.frontiersin.org/Journal/10.3389/fevo.2014.00016/full http://journal.frontiersin.org/Journal/10.3389/fevo.2014.00026/full http://journal.frontiersin.org/Journal/10.3389/fevo.2014.00027/full http://journal.frontiersin.org/Journal/10.3389/fgene.2011.00053/full http://journal.frontiersin.org/Journal/10.3389/fgene.2011.00069/full http://journal.frontiersin.org/Journal/10.3389/fgene.2011.00072/full http://journal.frontiersin.org/Journal/10.3389/fgene.2012.00301/full http://journal.frontiersin.org/Journal/10.3389/fgene.2014.00004/full http://journal.frontiersin.org/Journal/10.3389/fimmu.2012.00024/full http://journal.frontiersin.org/Journal/10.3389/fimmu.2012.00136/full http://journal.frontiersin.org/Journal/10.3389/fimmu.2013.00122/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2011.00053/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2011.00063/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2011.00090/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2011.00116/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00132/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00168/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00213/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00266/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00278/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00305/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00405/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2012.00444/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00084/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00095/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00151/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00190/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00192/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00217/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00291/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00322/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00330/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00366/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00381/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00413/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2013.00414/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00013/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00037/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00076/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00112/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00173/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00223/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00256/full http://journal.frontiersin.org/Journal/10.3389/fmicb.2014.00298/full http://journal.frontiersin.org/Journal/10.3389/fnana.2011.00007/full http://journal.frontiersin.org/Journal/10.3389/fnana.2012.00017/full http://journal.frontiersin.org/Journal/10.3389/fnana.2012.00050/full http://journal.frontiersin.org/Journal/10.3389/fncel.2013.00247/full http://journal.frontiersin.org/Journal/10.3389/fncir.2013.00178/full http://journal.frontiersin.org/Journal/10.3389/fnevo.2011.00002/full http://journal.frontiersin.org/Journal/10.3389/fnhum.2011.00053/full http://journal.frontiersin.org/Journal/10.3389/fnhum.2013.00245/full http://journal.frontiersin.org/Journal/10.3389/fnhum.2014.00345/full http://journal.frontiersin.org/Journal/10.3389/fnins.2011.00138/full http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00118/full http://journal.frontiersin.org/Journal/10.3389/fnmol.2011.00052/full http://journal.frontiersin.org/Journal/10.3389/fnmol.2014.00048/full http://journal.frontiersin.org/Journal/10.3389/fnsys.2011.00073/full http://journal.frontiersin.org/Journal/10.3389/fphar.2012.00115/full http://journal.frontiersin.org/Journal/10.3389/fphys.2013.00164/full http://journal.frontiersin.org/Journal/10.3389/fphys.2013.00342/full http://journal.frontiersin.org/Journal/10.3389/fpls.2011.00005/full http://journal.frontiersin.org/Journal/10.3389/fpls.2011.00011/full http://journal.frontiersin.org/Journal/10.3389/fpls.2011.00110/full http://journal.frontiersin.org/Journal/10.3389/fpls.2012.00001/full http://journal.frontiersin.org/Journal/10.3389/fpls.2012.00022/full http://journal.frontiersin.org/Journal/10.3389/fpls.2012.00159/full http://journal.frontiersin.org/Journal/10.3389/fpls.2012.00227/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00250/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00261/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00327/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00367/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00377/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00386/full http://journal.frontiersin.org/Journal/10.3389/fpls.2013.00547/full http://journal.frontiersin.org/Journal/10.3389/fpls.2014.00179/full http://journal.frontiersin.org/Journal/10.3389/fpls.2014.00296/full http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00163/full http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00282/full http://journal.frontiersin.org/Journal/10.3389/fpubh.2014.00043/full http://journal.frontiersin.org/Journal/10.3389/neuro.02.026.2009/full