mgalley / DSTC7-End-to-End-Conversation-Modeling

Grounded conversational dataset for end-to-end conversational AI (official DSTC7 data)
http://workshop.colips.org/dstc7/
174 stars 31 forks source link

error "http.client.RemoteDisconnected: Remote end closed connection without response" #3

Closed ypruan closed 6 years ago

ypruan commented 6 years ago

many errors in xxx.err files:

Traceback (most recent call last): File "/home/ypruan/local_work/DSTC7-End-to-End-Conversation-Modeling/data_extraction_official/src/commoncrawl.py", line 74, in download u = urllib.request.urlopen(iurl) File "/home/ypruan/anaconda3/lib/python3.6/urllib/request.py", line 223, in urlopen return opener.open(url, data, timeout) File "/home/ypruan/anaconda3/lib/python3.6/urllib/request.py", line 526, in open response = self._open(req, data) File "/home/ypruan/anaconda3/lib/python3.6/urllib/request.py", line 544, in _open '_open', req) File "/home/ypruan/anaconda3/lib/python3.6/urllib/request.py", line 504, in _call_chain result = func(*args) File "/home/ypruan/anaconda3/lib/python3.6/urllib/request.py", line 1346, in http_open return self.do_open(http.client.HTTPConnection, req) File "/home/ypruan/anaconda3/lib/python3.6/urllib/request.py", line 1321, in do_open r = h.getresponse() File "/home/ypruan/anaconda3/lib/python3.6/http/client.py", line 1331, in getresponse response.begin() File "/home/ypruan/anaconda3/lib/python3.6/http/client.py", line 297, in begin version, status, reason = self._read_status() File "/home/ypruan/anaconda3/lib/python3.6/http/client.py", line 266, in _read_status raise RemoteDisconnected("Remote end closed connection without" http.client.RemoteDisconnected: Remote end closed connection without response During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/create_official_data.py", line 246, in get_submissions s = add_webpage(s, year, month) File "src/create_official_data.py", line 151, in add_webpage return add_cc_webpage(submission, year, month) File "src/create_official_data.py", line 156, in add_cc_webpage src, date = cc.download(url, year, month, False) File "/home/ypruan/local_work/DSTC7-End-to-End-Conversation-Modeling/data_extraction_official/src/commoncrawl.py", line 121, in download traceback.print_exc() NameError: name 'traceback' is not defined

It seems that remote server reject the local request, how to solve this?