elliotgao2 / gain

Web crawling framework based on asyncio.
GNU General Public License v3.0
2.04k stars 207 forks source link

SSL handshake failed on verifying the certificate #47

Open 38602629 opened 6 years ago

38602629 commented 6 years ago

[2018:10:25 16:14:03] Spider started! [2018:10:25 16:14:03] Base url: https://blog.scrapinghub.com/ [2018:10:25 16:14:04] SSL handshake failed on verifying the certificate protocol: <uvloop.loop.SSLProtocol object at 0x10729acc0> transport: <TCPTransport closed=False reading=False 0x7fe65248c048> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 609, in uvloop.loop.SSLProtocol._on_handshake_complete File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:04] SSL error errno:1 reason: CERTIFICATE_VERIFY_FAILED protocol: <uvloop.loop.SSLProtocol object at 0x10729acc0> transport: <TCPTransport closed=False reading=False 0x7fe65248c048> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 504, in uvloop.loop.SSLProtocol.data_received File "uvloop/sslproto.pyx", line 204, in uvloop.loop._SSLPipe.feed_ssldata File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:05] SSL handshake failed on verifying the certificate protocol: <uvloop.loop.SSLProtocol object at 0x10729ae80> transport: <TCPTransport closed=False reading=False 0x7fe6549908b8> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 609, in uvloop.loop.SSLProtocol._on_handshake_complete File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:05] SSL error errno:1 reason: CERTIFICATE_VERIFY_FAILED protocol: <uvloop.loop.SSLProtocol object at 0x10729ae80> transport: <TCPTransport closed=False reading=False 0x7fe6549908b8> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 504, in uvloop.loop.SSLProtocol.data_received File "uvloop/sslproto.pyx", line 204, in uvloop.loop._SSLPipe.feed_ssldata File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:05] SSL handshake failed on verifying the certificate protocol: <uvloop.loop.SSLProtocol object at 0x10729aeb8> transport: <TCPTransport closed=False reading=False 0x7fe652738418> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 609, in uvloop.loop.SSLProtocol._on_handshake_complete File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:05] SSL error errno:1 reason: CERTIFICATE_VERIFY_FAILED protocol: <uvloop.loop.SSLProtocol object at 0x10729aeb8> transport: <TCPTransport closed=False reading=False 0x7fe652738418> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 504, in uvloop.loop.SSLProtocol.data_received File "uvloop/sslproto.pyx", line 204, in uvloop.loop._SSLPipe.feed_ssldata File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:05] SSL handshake failed on verifying the certificate protocol: <uvloop.loop.SSLProtocol object at 0x1072d0080> transport: <TCPTransport closed=False reading=False 0x7fe654994308> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 609, in uvloop.loop.SSLProtocol._on_handshake_complete File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:05] SSL error errno:1 reason: CERTIFICATE_VERIFY_FAILED protocol: <uvloop.loop.SSLProtocol object at 0x1072d0080> transport: <TCPTransport closed=False reading=False 0x7fe654994308> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 504, in uvloop.loop.SSLProtocol.data_received File "uvloop/sslproto.pyx", line 204, in uvloop.loop._SSLPipe.feed_ssldata File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:06] SSL handshake failed on verifying the certificate protocol: <uvloop.loop.SSLProtocol object at 0x1072d0208> transport: <TCPTransport closed=False reading=False 0x7fe6527bef38> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 609, in uvloop.loop.SSLProtocol._on_handshake_complete File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:06] SSL error errno:1 reason: CERTIFICATE_VERIFY_FAILED protocol: <uvloop.loop.SSLProtocol object at 0x1072d0208> transport: <TCPTransport closed=False reading=False 0x7fe6527bef38> Traceback (most recent call last): File "uvloop/sslproto.pyx", line 504, in uvloop.loop.SSLProtocol.data_received File "uvloop/sslproto.pyx", line 204, in uvloop.loop._SSLPipe.feed_ssldata File "uvloop/sslproto.pyx", line 171, in uvloop.loop._SSLPipe.feed_ssldata File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 763, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1045) [2018:10:25 16:14:06] Item "Post": 0 [2018:10:25 16:14:06] Requests count: 0 [2018:10:25 16:14:06] Error count: 0 [2018:10:25 16:14:06] Time usage: 0:00:03.345306 [2018:10:25 16:14:06] Spider finished!

Process finished with exit code 0

kwuite commented 5 years ago

@38602629 , can you confirm whether you have this problem on this PR: https://github.com/gaojiuli/gain/pull/50. I have never encoutnered such error and would like to know if this exists.

50 supports python 3.6 and 3.7 only.