DanMcInerney / xsscrapy

XSS spider - 66/66 wavsep XSS detected
1.66k stars 441 forks source link

Switched to scrapy 1.1.0rc3 to fix SSL bug (Updated #31) #32

Closed ddworken closed 8 years ago

ddworken commented 8 years ago

This is an updated and fixed version of #31.

Scrapy prior to 1.1.0rc3 had an issue where it would fail to connect to certain servers with an error stating <twisted.python.failure.Failure OpenSSL.SSL.Error: ('SSL routines', 'SSL3_READ_BYTES', 'sslv3 alert handshake failure'), ('SSL routines', 'SSL3_WRITE_BYTES', 'ssl handshake failure')>. See scrapy/scrapy#1764 for more info on this issue.

In that github issue, there were two potential solutions. Either add additional code forcing it to the correct code (see scrapy/scrapy#1764). The other potential solution was upgrading to the latest release of scrapy. Given this choice, went for upgrading scrapy.

This required changing the locations of a few imports, updating the logging method, and fixing the redirection.

ddworken commented 8 years ago

Thanks!