search

wummel / linkchecker

check links in web documents or full websites
http://wummel.github.io/linkchecker/
GNU General Public License v2.0
1.42k stars 234 forks source link

Segfault at 24 error 6 in python 2.7 #622

Open gresakg opened 8 years ago

gresakg commented 8 years ago

After running for more than 5 days on a very large website, linkchecker exited without error. I found this message in the kernel log

monitor kernel: [463505.201638] linkchecker[3894]: segfault at 24 ip 0000000000557db8 sp 00007f96a9fcfda0 error 6 in python2.7[400000+2bc000]

Linkchecker was running on Ubuntu

Linux monitor 3.19.0-31-generic #36~14.04.1-Ubuntu SMP Thu Oct 8 10:21:08 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

This is the command used linkchecker --no-warnings http://med.over.net 2> check.log

And these are the contents of the config files

[output]
# enable debug messages; see 'linkchecker -h' for valid debug names
#debug=all
# print status output
#status=1
# change the logging type
log=html
# turn on/off --verbose
#verbose=1
# turn on/off --warnings
warnings=0
# turn on/off --quiet
quiet=0
# additional file output
fileoutput = html, sql

[html]
parts=realurl,result,extern,base,parenturl,dltime,checktime,url,intro,outro

Also, is there a way to resume the scan or are all the queued url's lost?

dpalic commented 6 years ago

Thank you for the issue report. Sadly this project is dead, and a new team is around with https://github.com/linkcheck/linkchecker for more details please see: #708 Also please close this issue and report it freshly on the new repo https://github.com/linkcheck/linkchecker/issues if your issue still persists