Strange failure on redirect URL that doesn't redirect

bryanteastham commented 8 years ago

The following public URL fails: https://opendof.org/pledge

The result says "Error: 403 Bad Behavior". This is part of a larger site that I am checking, but this URL (and several like it on the same site) all fail the same way.

The debug log shows the following, which seems to indicate that the redirect is not being understood. Note that using curl (or browser) shows no 403 failure.

DEBUG 2016-05-23 10:26:56,517 CheckThread-https://opendof.org/pledge Checking https link
base_url=u'https://opendof.org/pledge'
parent_url=None
base_ref=None
recursion_level=0
url_connection=None
line=0
column=0
page=0
name=u''
anchor=u''
cache_url=https://opendof.org/pledge
DEBUG 2016-05-23 10:26:56,517 CheckThread-https://opendof.org/pledge checking connection
DEBUG 2016-05-23 10:26:57,686 CheckThread-https://opendof.org/pledge u'https://opendof.org/robots.txt' allow all (request error)
DEBUG 2016-05-23 10:26:57,687 CheckThread-https://opendof.org/pledge u'https://opendof.org/robots.txt' check allowance for:
  user agent: u'Mozilla/5.0 (compatible; LinkChecker/9.3; +http://wummel.github.io/linkchecker/)'
  url: u'https://opendof.org/pledge' ...
DEBUG 2016-05-23 10:26:57,687 CheckThread-https://opendof.org/pledge  ... allow all.
DEBUG 2016-05-23 10:26:57,687 CheckThread-https://opendof.org/pledge Prepare request with {'url': u'https://opendof.org/pledge', 'headers': {}, 'method': 'GET'}
DEBUG 2016-05-23 10:26:57,687 CheckThread-https://opendof.org/pledge Send request with {'verify': 'C:\\Program Files (x86)\\LinkChecker\\share\\linkchecker\\cacert.pem', 'allow_redirects': False, 'stream': True, 'timeout': 60}
DEBUG 2016-05-23 10:27:00,230 CheckThread-https://opendof.org/pledge Got SSL certificate {'notAfter': 'Apr 24 12:00:00 2017 GMT', 'subjectAltName': (('DNS', 'opendof.org'), ('DNS', 'issue.opendof.org'), ('DNS', 'source.opendof.org'), ('DNS', 'build.opendof.org'), ('DNS', 'interface.opendof.org'), ('DNS', 'testing.opendof.org'), ('DNS', 'asset.opendof.org')), 'subject': ((('countryName', u'US'),), (('stateOrProvinceName', u'Oregon'),), (('localityName', u'Beaverton'),), (('organizationName', u'OpenDOF Project, Inc.'),), (('commonName', u'opendof.org'),))}
DEBUG 2016-05-23 10:27:00,230 CheckThread-https://opendof.org/pledge follow all redirections
DEBUG 2016-05-23 10:27:00,230 CheckThread-https://opendof.org/pledge task_done https://opendof.org/pledge

peterjacobs commented 7 years ago

dpalic commented 6 years ago

Thank you for the issue report. Sadly this project is dead, and a new team is around with https://github.com/linkcheck/linkchecker for more details please see: #708 Also please close this issue and report it freshly on the new repo https://github.com/linkcheck/linkchecker/issues if your issue still persists

wummel / linkchecker

Strange failure on redirect URL that doesn't redirect #659