search

wummel / linkchecker

check links in web documents or full websites
http://wummel.github.io/linkchecker/
GNU General Public License v2.0
1.42k stars 234 forks source link

Occasional BadStatusLine errors #692

Closed ghost closed 7 years ago

ghost commented 7 years ago

I'm getting occasional BadStatusLine errors from a good host; the errors are intermittent and not consistently at the same urls.

Error message reads: Error: ConnectionError:('Connection aborted', BadStatusLine([long string of apparently complete random gibberish...]))

Googling suggests this might be the result of bad management by the python libraries of connections where the server KeepAlive times out and closes the connection. Is that likely? I'm using python 2.7.5 on CentOS.

ghost commented 7 years ago

Found this was a networking problem with http headers occasionally being removed by the proxy. So linkchecker was reporting the error correctly.