wso4133560 / download_git_issues

做github的issues爬取
0 stars 0 forks source link

为什么会报这个错呀? #1

Open MabelQi opened 2 years ago

MabelQi commented 2 years ago

mabel@MabeldeMacBook-Pro download_git_issues-main % python3 main.py issues 开始爬取issues list: https://github.com/dotnet/runtime/issues Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connection.py", line 159, in _new_conn conn = connection.create_connection( File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/util/connection.py", line 84, in create_connection raise err File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/util/connection.py", line 74, in create_connection sock.connect(sa) ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connectionpool.py", line 667, in urlopen self._prepare_proxy(conn) File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connectionpool.py", line 932, in _prepare_proxy conn.connect() File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connection.py", line 309, in connect conn = self._new_conn() File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connection.py", line 171, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x10b573cd0>: Failed to establish a new connection: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "main.py", line 88, in do() File "main.py", line 24, in do crawl_and_scrape('issues') File "main.py", line 58, in crawl_and_scrape issue_list = github_issues_spider.get_issues(url) File "/Users/mabel/Desktop/download_git_issues-main/spiders/github_issues_spider.py", line 83, in get_issues html = get_url_page(url) File "/Users/mabel/Desktop/download_git_issues-main/spiders/github_issues_spider.py", line 18, in get_url_page response = proxy.request('GET', url) File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/request.py", line 75, in request return self.request_encode_url( File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/request.py", line 97, in request_encode_url return self.urlopen(method, url, extra_kw) File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/poolmanager.py", line 488, in urlopen return super(ProxyManager, self).urlopen(method, url, redirect=redirect, kw) File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/poolmanager.py", line 336, in urlopen response = conn.urlopen(method, u.request_uri, **kw) File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connectionpool.py", line 754, in urlopen return self.urlopen( File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connectionpool.py", line 754, in urlopen return self.urlopen( File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connectionpool.py", line 754, in urlopen return self.urlopen( File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/connectionpool.py", line 726, in urlopen retries = retries.increment( File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/urllib3/util/retry.py", line 446, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='github.com', port=443): Max retries exceeded with url: /dotnet/runtime/issues (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x10b573cd0>: Failed to establish a new connection: [Errno 61] Connection refused')))

MabelQi commented 2 years ago

pip install -r requirements.txt之后再配置好数据库 还需要配置其他文件吗???