edx-dl fails to download a file due to "Got SSL/Connection error: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url".
Your environment
Operating System (name/version): Windows 10 Version 1903(OS Build: 18362.592)
The downloads should continue. Even if it cannot download a particular file it should skip it, and move on to the next file and display the files that have been not download along with their URL.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 600, in urlopen
chunked=chunked)
File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 354, in _make_request
conn.request(method, url, **httplib_request_kw)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1229, in request
self._send_request(method, url, body, headers, encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1275, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1224, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1016, in _send_output
self.send(msg)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 956, in send
self.connect()
File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 181, in connect
conn = self._new_conn()
File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 168, in _new_conn
self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\adapters.py", line 449, in send
timeout=timeout
File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 638, in urlopen
_stacktrace=sys.exc_info()[2])
File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\util\retry.py", line 398, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url: /~ansaf/CING/CCLS-13-04.pdf (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "edx-dl.py", line 8, in
edx_dl.main()
File "G:\edX Courses\edx_dl\edx_dl.py", line 1073, in main
download(args, selections, filtered_units, headers)
File "G:\edX Courses\edx_dl\edx_dl.py", line 850, in download
headers)
File "G:\edX Courses\edx_dl\edx_dl.py", line 822, in download_unit
skip_or_download(res_downloads, headers, args)
File "G:\edX Courses\edx_dl\edx_dl.py", line 781, in skip_or_download
f(url, filename, headers, args)
File "G:\edX Courses\edx_dl\edx_dl.py", line 736, in download_url
raise e
File "G:\edX Courses\edx_dl\edx_dl.py", line 728, in download_url
r = requests.get(url, headers=headers)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\api.py", line 75, in get
return request('get', url, params=params, kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\api.py", line 60, in request
return session.request(method=method, url=url, kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\sessions.py", line 533, in request
resp = self.send(prep, send_kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\sessions.py", line 646, in send
r = adapter.send(request, kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\adapters.py", line 516, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url: /~ansaf/CING/CCLS-13-04.pdf (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed'))`
Workaround
If we create a dummy file having the same name as the one it failed to download in the respective folder, the program skips the file and starts downloading the rest of the files. Though, such work around exists, it is my request to the author(s) to implemented what is described in the expected behavior.
Subject of the issue
edx-dl fails to download a file due to "Got SSL/Connection error: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url".
Your environment
Steps to reproduce
The error occurs when trying to download the following course https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/course/
Expected behaviour
The downloads should continue. Even if it cannot download a particular file it should skip it, and move on to the next file and display the files that have been not download along with their URL.
Actual behaviour
This is the output of edx-dl.
pythonedx-dl.py -u email@email.com https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/course/edx_dl version 0.1.13 Password: Building initial headers for future requests. Getting initial CSRF token. Found CSRF token. Logging into Open edX site: https://courses.edx.org/login_ajax Extracting course information from dashboard. Downloading Machine Learning for Data Science and Analytics [course-v1:ColumbiaX+DS102X+2T2019/co] Downloading 8 section(s) Section 1: Introduction to the course Course Introduction Course Overview Introduce yourself Section 2: Week 1: Algorithms 1 Week 1 Reading List 1.1 Algorithms and Machine Learning 1.2 Introduction to Algorithms 1.2 Assignment 1.3 Tools to Analyze Algorithms 1.3 Assignment 1.4 Algorithmic Technique: Divide and Conquer 1.5 Divide and Conquer Example: Investing 1.5 Assignment 1.6 Randomization in Algorithms 1.6 Assignment 1.7 Application Area Scheduling 1 1.8 Application Area Scheduling 2 1.8 Optional Assignment Section 3: Week 2: Algorithms 2 Week 2 Reading List 2.1 Graphs 2.1 Assignment 2.2 Some Ideas Behind Map Searches 1 2.3 Some Ideas Behind Map Searches 2 2.3 Assignment 2.4 Application of Algorithms: Stable Marriages Example 2.4 Assignment 2.5 Dictionaries and Hashing 2.5 Assignment 2.6 Search Trees 2.6 Assignment 2.7 Dynamic Programming 1 2.8 Dynamic Programming 2 2.8 Assignment Section 4: Week 3: Algorithms 3 and Application to Personal Genomics 3.1 Linear Programming 1 3.2 Linear Programming 2 3.2 Assignment 3.3 NP-completeness 1 3.4 NP-completeness 2 3.5 NP-completeness 3 and Summary 3.5 Assignment 3.6 Introduction to Personal Genomics 3.6 Assignment 3.7 Massive Raw Data In Genomics 3.7 Assignment 3.8 Data Science On Personal Genomes 3.9 Interconnectedness Of Personal Genomes 3.9 Assignment 3.10 Personal Genomics Case Studies 3.10 Assignment 3.11 Personal Genomics Conclusion Section 5: Week 4: Machine Learning Week 4 Reading List 4.1 Algorithms in Machine Learning Introduction 4.2 What Is Machine Learning 1 4.3 What Is Machine Learning 2 4.4 Classification 4.4 Assignment 4.5 Linear Classifiers 4.5 Assignment 4.6 Ensemble Classifiers 4.6 Assignment 4.7 Model Selection 4.8 Cross Validation 4.8 Assignment 4.9 Machine Learning Summary 4.10 (optional) Assignment Section 6: Week 5: Machine Learning Applications Week 5 Reading List 5.1 Machine Learning Application: Introduction to Probabilistic Topic Models 5.2 Probabilistic Modeling 1 5.3 Probabilistic Modeling 2 5.4 Topic Modeling 5.5 Probabilistic Inference 5.5 Assignment 5.6 Machine Learning Application: Prediction of Preterm Birth 5.7 Data Description and Preparation 5.7 Assignment 5.8 Methods for Prediction of Preterm Birth 5.9 Results and Discussion 5.10 Summary and Conclusion 5.10 Assignment 5.11 Assignment 5.11 Relation Between Machine Learning and Statistics 5.12 Topic Model Assignment 5.13 Course Conclusion Subsection Section 7: (Optional) Learn setting up an instance in AWS Overview of AWS Cloud Service Section 8: Testing for Google Form Google Form Extracting all units information in parallel. Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@7dc118a346b14f40bd5e8781469e7ec3' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@3158ddea90a546029a27e97151dc9f41' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@ef09fed6567f43fba3c8011b5f3f95c5' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@2d5ea96f399c4bf4a2eb8592f4bf6b2a' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@f2288d69de6e4053aaa03fe96518d525' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@8ac3b445fead4237bb4ce744cdf52936' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@924c1af6744f4f1fbe9db5dd4fb1e485' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@bb660e1913f3491385055d3a33554971' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@1c9a4602ce3d4e7bbce32b26d8b9c360' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@8eb33db9513543228e6bc7d691d04175' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@f94ad3af698c4c25a0c6e0574fda4a62' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@fc2b445d908446999c7e1ece424af040' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@403b849df0014121a2131475952ca9a1' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@8675c6df80a54a29bdbe2ff2aadd18ba' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@012511a5dbe244a88fd1b891a7258022' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@fa618a4e413c4233819af122633d4782' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@b1033edcae644c4dae12a570b57ed08f' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@ad6e1211b1d7407a83c95896f83799fb' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@48cf9907fe424ab5ad7e60fbd0d2ce22' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@c8c647ad68714507b089b548152c88f9' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@fdd79354ac1c4c2299c852b312d0d023' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@9d086fecf05a4b3d9b6496bf3b431765' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@0c1db25f5e354e479b02fd77e7ea36c3' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@23af903e1749405899a5d26f3048e237' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@b6029455168842cba8ceb1d0f0a742cf' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@c408b0efc7524c0aa9bad10dccd7d50f' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@75cea25a80a343218f35eb3df9f90a7f' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@159f29ba0fa14f189367550219758e86' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@b0ba01a3e76c463d9738bbab64a957d9' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@2bef8235652a43ac9fd2dfe45be2b0f5' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@02d5595c45fb42aba4310dae406be488' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@c5a88e21bac7493f95c87d4ee8a849d4' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@a5480e06518b4b2ca7e3956ae31186c0' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@c308770ab1f0438e8a8ea977297a3579' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@dcc3522ec5d24ea5bbe4edf170edd9ce' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@9ebf698add9747308107296b5d702544' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@06676df9c82f44e392276ce770d9806a' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@d4b1aa9735d94cecb83ec23e932786ac' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@31bf064446bf4dd296c892463f485787' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@d16baa00d2b3466ba0892a8199d246d5' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@c08eb54f747a4c13af1ef82e1b54e4b3' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@dc17c39a2995484c8c9704691f6d764c' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@7d61f3fb5aae4223a921561dbcae1e38' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@f795ad6408af4fcf9a53f81d7d790b7a' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@f989ffbb924247c9a152b117c879be88' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@a1fce8ce4aa44c1db69cf84f9c8870ab' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@e0d2238e140242fb8508fa018308266a' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@6d43ac3586ae4deb905b65daa4b5cc5c' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@8b61d0297b21454dbd954ba0fc8a8332' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@bf6ef3f1a4cd47b281151b113b616778' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@7af1e59a653a451a8cca8d9b8ab5f169' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@6ed2d963d044405396c69a11cd4b5f6d' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@5772535683584179b659f0370ca80f62' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@14c9a9167f9e4f2e802c5094dcd187d5' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@22ce10f391934f9cb6c55451f3485739' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@34572882dcb0429e8bbd12b7cc00ac3d' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@c35bbfe85ad74b64b74fc7230769a357' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@2f85204bd7914529b4f7c2d7cfd236c8' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@3daa05335ec74c0bb7758f008d70fbd5' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@3e25baa08c5f4887a7210ca179e1ab0b' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@63ffcb5029b04922ab36e8fa9befd2ed' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@d10622b127d7434b8ade98ecabc98437' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@d09ff04725254a678b1b5a03906ca968' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@e98db0772e2e4ecf990cc77c05ed0ed2' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@99519fac94434de48071a6255e78ceb0' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@f4272182af3846c490b954ab18021616' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@db19aca5cd4b4b688cdfd465a5b2161e' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@8a99f15f0b8a4d029ebfae19a24958a7' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@55852f3939e9455fbe0163c7a45f6bb0' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@25de6dbc00374e9096ba34758cd10705' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@3a585a8d85f645b08906533397b637fe' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@2c6412533b8c418d87fd7496649b82b5' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@89c918b7927b4c848d651e774b26f0e2' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@4ae805bfc6374598a7bfe4b791e7cb87' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@37aec120b9c6444cba2dae41e1a27562' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@397af9825ba0453e86c13a1bb1bc1af2' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@018e7d0efa8644c3a4e580f1f3090c00' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@19acf9c1dfba422db15042e377d66467' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@548c20d6180642189aad9e9acac0eb35' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@35b3dea17f7f4d348fecf742bfea88b6' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@46e869f74209406abdbcd693f309b6de' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@16966e52346741eebf1061456a2f834f' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@b5dea64573dc44caa6ccb6f02d946cf4' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@f005135fd1a740a698bf2c81e891c702' Processing 'https://courses.edx.org/courses/course-v1:ColumbiaX+DS102X+2T2019/jump_to/block-v1:ColumbiaX+DS102X+2T2019+type@sequential+block@d13a4becb7e7475f9c712a6c0f7d64ff' Removed 0 duplicated urls from 243 in total Output directory: Downloaded [download] https://youtube.com/watch?v=-PCFxkWcatg => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\01-Introduction_to_the_course\01-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=-PCFxkWcatg from YouTube. [youtube] -PCFxkWcatg: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\01-Introduction_to_the_course\01-COLDS10XT315-V030200--PCFxkWcatg.mp4 has already been downloaded [download] 100% of 64.85MiB [skipping] https://courses.edx.org/assets/courseware/v1/9020f1ea5293f47aec1c5cd03cf0d1e0/asset-v1:ColumbiaX+DS102X+2T2019+type@asset+block/A_Few_Useful_Things_MachineLearning_Domingos.pdf => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\01-A_Few_Useful_Things_MachineLearning_Domingos.pdf [download] https://youtube.com/watch?v=3jYxp6OP3ms => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\02-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=3jYxp6OP3ms from YouTube. [youtube] 3jYxp6OP3ms: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\02-COLDS10XT315-V006900-3jYxp6OP3ms.mp4 has already been downloaded [download] 100% of 92.31MiB [download] https://youtube.com/watch?v=W3k7ARtWpa8 => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\03-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=W3k7ARtWpa8 from YouTube. [youtube] W3k7ARtWpa8: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\03-COLDS10XT315-V025400-W3k7ARtWpa8.mp4 has already been downloaded [download] 100% of 231.18MiB [download] https://youtube.com/watch?v=b_Bo1mPhWYo => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\04-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=b_Bo1mPhWYo from YouTube. [youtube] b_Bo1mPhWYo: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\04-COLDS10XT315-V025100-b_Bo1mPhWYo.mp4 has already been downloaded [download] 100% of 244.22MiB [download] https://youtube.com/watch?v=P11QzHVgUoY => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\05-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=P11QzHVgUoY from YouTube. [youtube] P11QzHVgUoY: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\05-COLDS10XT315-V025300-P11QzHVgUoY.mp4 has already been downloaded [download] 100% of 161.31MiB [download] https://youtube.com/watch?v=sbSAkrLIT3g => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=sbSAkrLIT3g from YouTube. [youtube] sbSAkrLIT3g: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\06-COLDS10XT315-V026000-sbSAkrLIT3g.mp4 has already been downloaded [download] 100% of 224.33MiB [download] https://youtube.com/watch?v=RZKVjQCgVRI => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\07-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=RZKVjQCgVRI from YouTube. [youtube] RZKVjQCgVRI: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\07-COLDS10XT315-V007400-RZKVjQCgVRI.mp4 has already been downloaded [download] 100% of 16.96MiB [download] https://youtube.com/watch?v=FQdVhn5B_pc => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\08-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=FQdVhn5B_pc from YouTube. [youtube] FQdVhn5B_pc: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\08-COLDS10XT315-V025500-FQdVhn5B_pc.mp4 has already been downloaded [download] 100% of 178.74MiB [download] https://youtube.com/watch?v=dvv5BA6EqaM => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\09-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=dvv5BA6EqaM from YouTube. [youtube] dvv5BA6EqaM: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\09-COLDS10XT315-V025700-dvv5BA6EqaM.mp4 has already been downloaded [download] 100% of 139.48MiB [download] https://youtube.com/watch?v=Ubh7DDXxQ88 => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\10-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=Ubh7DDXxQ88 from YouTube. [youtube] Ubh7DDXxQ88: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\10-COLDS10XT315-V007100-Ubh7DDXxQ88.mp4 has already been downloaded [download] 100% of 99.23MiB [download] https://youtube.com/watch?v=4Kfd9p-1MRg => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\11-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=4Kfd9p-1MRg from YouTube. [youtube] 4Kfd9p-1MRg: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\02-Week_1-_Algorithms_1\11-COLDS10XT315-V007500-4Kfd9p-1MRg.mp4 has already been downloaded [download] 100% of 68.63MiB [download] https://youtube.com/watch?v=cIgovsXBQRk => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\01-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=cIgovsXBQRk from YouTube. [youtube] cIgovsXBQRk: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\01-COLDS10XT315-V025200-cIgovsXBQRk.mp4 has already been downloaded [download] 100% of 187.63MiB [download] https://youtube.com/watch?v=vGjP8SUCDjo => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\02-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=vGjP8SUCDjo from YouTube. [youtube] vGjP8SUCDjo: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\02-COLDS10XT315-V025800-vGjP8SUCDjo.mp4 has already been downloaded [download] 100% of 169.03MiB [download] https://youtube.com/watch?v=H-G7dieAYH0 => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\03-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=H-G7dieAYH0 from YouTube. [youtube] H-G7dieAYH0: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\03-COLDS10XT315-V025900-H-G7dieAYH0.mp4 has already been downloaded [download] 100% of 133.77MiB [download] https://youtube.com/watch?v=Zbkj8DrPrVw => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\04-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=Zbkj8DrPrVw from YouTube. [youtube] Zbkj8DrPrVw: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\04-COLDS10XT315-V026300-Zbkj8DrPrVw.mp4 has already been downloaded [download] 100% of 152.74MiB [download] https://youtube.com/watch?v=r8RY455Sdvc => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\05-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=r8RY455Sdvc from YouTube. [youtube] r8RY455Sdvc: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\05-COLDS10XT315-V026400-r8RY455Sdvc.mp4 has already been downloaded [download] 100% of 99.79MiB [download] https://youtube.com/watch?v=XNWxGA6QXw8 => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=XNWxGA6QXw8 from YouTube. [youtube] XNWxGA6QXw8: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\06-COLDS10XT315-V026200-XNWxGA6QXw8.mp4 has already been downloaded [download] 100% of 155.20MiB [download] https://youtube.com/watch?v=pvEk0ySEhto => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\07-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=pvEk0ySEhto from YouTube. [youtube] pvEk0ySEhto: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\07-COLDS10XT315-V026100-pvEk0ySEhto.mp4 has already been downloaded [download] 100% of 203.21MiB [download] https://youtube.com/watch?v=nolrORje4cs => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\08-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=nolrORje4cs from YouTube. [youtube] nolrORje4cs: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\08-COLDS10XT315-V025600-nolrORje4cs.mp4 has already been downloaded [download] 100% of 116.41MiB [download] https://youtube.com/watch?v=ohhoVsWGaPo => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\09-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=ohhoVsWGaPo from YouTube. [youtube] ohhoVsWGaPo: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\09-COLDS10XT315-V010300-ohhoVsWGaPo.mp4 has already been downloaded [download] 100% of 30.38MiB [download] https://youtube.com/watch?v=28WSijdD-Bg => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\10-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=28WSijdD-Bg from YouTube. [youtube] 28WSijdD-Bg: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\10-COLDS10XT315-V008000-28WSijdD-Bg.mp4 has already been downloaded [download] 100% of 124.91MiB [download] https://youtube.com/watch?v=6I9BTeK8OQQ => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\11-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=6I9BTeK8OQQ from YouTube. [youtube] 6I9BTeK8OQQ: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\11-COLDS10XT315-V031000-6I9BTeK8OQQ.mp4 has already been downloaded [download] 100% of 271.38MiB [download] https://youtube.com/watch?v=U_0wxBH8o3s => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\12-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=U_0wxBH8o3s from YouTube. [youtube] U_0wxBH8o3s: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\12-COLDS10XT315-V029800-U_0wxBH8o3s.mp4 has already been downloaded [download] 100% of 36.27MiB [download] https://youtube.com/watch?v=z1wAssORsq4 => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\13-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=z1wAssORsq4 from YouTube. [youtube] z1wAssORsq4: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\13-COLDS10XT315-V026500-z1wAssORsq4.mp4 has already been downloaded [download] 100% of 81.40MiB [download] https://youtube.com/watch?v=HODhGDSMzZI => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\14-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=HODhGDSMzZI from YouTube. [youtube] HODhGDSMzZI: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\03-Week_2-_Algorithms_2\14-COLDS10XT315-V026800-HODhGDSMzZI.mp4 has already been downloaded [download] 100% of 101.35MiB [download] https://youtube.com/watch?v=Zampb1gro7E => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\01-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=Zampb1gro7E from YouTube. [youtube] Zampb1gro7E: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\01-COLDS10XT315-V026600-Zampb1gro7E.mp4 has already been downloaded [download] 100% of 78.63MiB [download] https://youtube.com/watch?v=Tq0TrXMklSk => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\02-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=Tq0TrXMklSk from YouTube. [youtube] Tq0TrXMklSk: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\02-COLDS10XT315-V027300-Tq0TrXMklSk.mp4 has already been downloaded [download] 100% of 72.67MiB [download] https://youtube.com/watch?v=YN-tsTuRGyU => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\03-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=YN-tsTuRGyU from YouTube. [youtube] YN-tsTuRGyU: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\03-COLDS10XT315-V027000-YN-tsTuRGyU.mp4 has already been downloaded [download] 100% of 63.20MiB [download] https://youtube.com/watch?v=nbOOwj-5IM8 => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\04-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=nbOOwj-5IM8 from YouTube. [youtube] nbOOwj-5IM8: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\04-COLDS10XT315-V026700-nbOOwj-5IM8.mp4 has already been downloaded [download] 100% of 58.22MiB [download] https://youtube.com/watch?v=kbm9Ppsbr-M => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\05-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=kbm9Ppsbr-M from YouTube. [youtube] kbm9Ppsbr-M: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\05-COLDS10XT315-V026900-kbm9Ppsbr-M.mp4 has already been downloaded [download] 100% of 55.67MiB [download] https://youtube.com/watch?v=gBDWxB5hjok => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=gBDWxB5hjok from YouTube. [youtube] gBDWxB5hjok: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\06-COLDS10XT315-V030400-gBDWxB5hjok.mp4 has already been downloaded [download] 100% of 270.74MiB [download] https://youtube.com/watch?v=jqIsMv09TKc => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\07-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=jqIsMv09TKc from YouTube. [youtube] jqIsMv09TKc: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\07-COLDS10XT315-V008800-jqIsMv09TKc.mp4 has already been downloaded [download] 100% of 156.02MiB [download] https://youtube.com/watch?v=itc2eW1X-zY => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\08-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=itc2eW1X-zY from YouTube. [youtube] itc2eW1X-zY: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\08-COLDS10XT315-V008700-itc2eW1X-zY.mp4 has already been downloaded [download] 100% of 136.09MiB [download] https://youtube.com/watch?v=nhj0N8jShgQ => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\09-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=nhj0N8jShgQ from YouTube. [youtube] nhj0N8jShgQ: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\09-COLDS10XT315-V008900-nhj0N8jShgQ.mp4 has already been downloaded [download] 100% of 112.99MiB [download] https://youtube.com/watch?v=cjxdD59g7uk => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\10-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=cjxdD59g7uk from YouTube. [youtube] cjxdD59g7uk: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\10-COLDS10XT315-V009000-cjxdD59g7uk.mp4 has already been downloaded [download] 100% of 40.31MiB [download] https://youtube.com/watch?v=UwbD8GE_T0I => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\11-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=UwbD8GE_T0I from YouTube. [youtube] UwbD8GE_T0I: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\04-Week_3-_Algorithms_3_and_Application_to_Personal_Genomics\11-COLDS10XT315-V009200-UwbD8GE_T0I.mp4 has already been downloaded [download] 100% of 44.07MiB [download] https://youtube.com/watch?v=o0beaI4CdOg => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\01-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=o0beaI4CdOg from YouTube. [youtube] o0beaI4CdOg: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\01-COLDS10XT315-V018300-o0beaI4CdOg.mp4 has already been downloaded [download] 100% of 17.42MiB [download] https://youtube.com/watch?v=x4eCM-LHcvs => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\02-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=x4eCM-LHcvs from YouTube. [youtube] x4eCM-LHcvs: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\02-COLDS10XT315-V023800-x4eCM-LHcvs.mp4 has already been downloaded [download] 100% of 190.76MiB [download] https://youtube.com/watch?v=HwXw5iYne1U => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\03-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=HwXw5iYne1U from YouTube. [youtube] HwXw5iYne1U: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\03-COLDS10XT315-V023600-HwXw5iYne1U.mp4 has already been downloaded [download] 100% of 155.20MiB [download] https://youtube.com/watch?v=oM5OedZrsHg => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\04-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=oM5OedZrsHg from YouTube. [youtube] oM5OedZrsHg: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\04-COLDS10XT315-V010200-oM5OedZrsHg.mp4 has already been downloaded [download] 100% of 112.81MiB [download] https://youtube.com/watch?v=yOtYsuDPkBw => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\05-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=yOtYsuDPkBw from YouTube. [youtube] yOtYsuDPkBw: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\05-COLDS10XT315-V023700-yOtYsuDPkBw.mp4 has already been downloaded [download] 100% of 194.74MiB [download] https://youtube.com/watch?v=6sSES4xMQRQ => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=6sSES4xMQRQ from YouTube. [youtube] 6sSES4xMQRQ: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\06-COLDS10XT315-V024000-6sSES4xMQRQ.mp4 has already been downloaded [download] 100% of 137.94MiB [download] https://youtube.com/watch?v=romehN1knfY => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\07-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=romehN1knfY from YouTube. [youtube] romehN1knfY: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\07-COLDS10XT315-V024700-romehN1knfY.mp4 has already been downloaded [download] 100% of 226.43MiB [download] https://youtube.com/watch?v=8EqYR6FuXqY => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\08-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=8EqYR6FuXqY from YouTube. [youtube] 8EqYR6FuXqY: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\08-COLDS10XT315-V024400-8EqYR6FuXqY.mp4 has already been downloaded [download] 100% of 232.75MiB [download] https://youtube.com/watch?v=OyO3BQExWTk => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\09-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=OyO3BQExWTk from YouTube. [youtube] OyO3BQExWTk: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\09-COLDS10XT315-V024100-OyO3BQExWTk.mp4 has already been downloaded [download] 100% of 223.90MiB [download] https://youtube.com/watch?v=XL6AbevC2YY => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\10-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=XL6AbevC2YY from YouTube. [youtube] XL6AbevC2YY: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\10-COLDS10XT315-V024300-XL6AbevC2YY.mp4 has already been downloaded [download] 100% of 290.44MiB [download] https://youtube.com/watch?v=Cmh-kppDkCM => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\11-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=Cmh-kppDkCM from YouTube. [youtube] Cmh-kppDkCM: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\11-COLDS10XT315-V024500-Cmh-kppDkCM.mp4 has already been downloaded [download] 100% of 203.86MiB [download] https://youtube.com/watch?v=ZBw2NFQ9H_g => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\12-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=ZBw2NFQ9H_g from YouTube. [youtube] ZBw2NFQ9H_g: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\12-COLDS10XT315-V024600-ZBw2NFQ9H_g.mp4 has already been downloaded [download] 100% of 246.80MiB [download] https://youtube.com/watch?v=uO9Q827q2rA => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\13-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=uO9Q827q2rA from YouTube. [youtube] uO9Q827q2rA: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\13-COLDS10XT315-V025000-uO9Q827q2rA.mp4 has already been downloaded [download] 100% of 102.58MiB [download] https://youtube.com/watch?v=OYsTcatr7wA => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\14-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=OYsTcatr7wA from YouTube. [youtube] OYsTcatr7wA: Downloading webpage [download] Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\14-COLDS10XT315-V024900-OYsTcatr7wA.mp4 has already been downloaded [download] 100% of 151.59MiB [skipping] https://courses.edx.org/assets/courseware/v1/051dbc789882b75bcc0b2071b2a442d4/asset-v1:ColumbiaX+DS102X+2T2019+type@asset+block/From_Linear_Regression_to_Logistic_Regression-assignment_revised.ipynb => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\05-Week_4-_Machine_Learning\15-From_Linear_Regression_to_Logistic_Regression-assignment_revised.ipynb [skipping] http://www.marchofdimes.org/materials/born-too-soon-global-action-report-on-preterm-birth.pdf => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\06-Week_5-_Machine_Learning_Applications\01-born-too-soon-global-action-report-on-preterm-birth.pdf [download] http://www1.ccls.columbia.edu/~ansaf/CING/CCLS-13-04.pdf => Downloaded\Machine_Learning_for_Data_Science_and_Analytics\06-Week_5-_Machine_Learning_Applications\01-CCLS-13-04.pdf Got SSL/Connection error: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url: /~ansaf/CING/CCLS-13-04.pdf (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed')) Hint: if you want to ignore this error, add --ignore-errors option to the command line Traceback (most recent call last): File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 159, in _new_conn (self._dns_host, self.port), self.timeout, **extra_kw) File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\util\connection.py", line 57, in create_connection for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): File "C:\ProgramData\Anaconda3\lib\socket.py", line 748, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno 11001] getaddrinfo failed
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 600, in urlopen chunked=chunked) File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 354, in _make_request conn.request(method, url, **httplib_request_kw) File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1229, in request self._send_request(method, url, body, headers, encode_chunked) File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1275, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1224, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1016, in _send_output self.send(msg) File "C:\ProgramData\Anaconda3\lib\http\client.py", line 956, in send self.connect() File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 181, in connect conn = self._new_conn() File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 168, in _new_conn self, "Failed to establish a new connection: %s" % e) urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "C:\ProgramData\Anaconda3\lib\site-packages\requests\adapters.py", line 449, in send timeout=timeout File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 638, in urlopen _stacktrace=sys.exc_info()[2]) File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\util\retry.py", line 398, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url: /~ansaf/CING/CCLS-13-04.pdf (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "edx-dl.py", line 8, in
edx_dl.main()
File "G:\edX Courses\edx_dl\edx_dl.py", line 1073, in main
download(args, selections, filtered_units, headers)
File "G:\edX Courses\edx_dl\edx_dl.py", line 850, in download
headers)
File "G:\edX Courses\edx_dl\edx_dl.py", line 822, in download_unit
skip_or_download(res_downloads, headers, args)
File "G:\edX Courses\edx_dl\edx_dl.py", line 781, in skip_or_download
f(url, filename, headers, args)
File "G:\edX Courses\edx_dl\edx_dl.py", line 736, in download_url
raise e
File "G:\edX Courses\edx_dl\edx_dl.py", line 728, in download_url
r = requests.get(url, headers=headers)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\api.py", line 75, in get
return request('get', url, params=params, kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\api.py", line 60, in request
return session.request(method=method, url=url, kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\sessions.py", line 533, in request
resp = self.send(prep, send_kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\sessions.py", line 646, in send
r = adapter.send(request, kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\requests\adapters.py", line 516, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='www1.ccls.columbia.edu', port=80): Max retries exceeded with url: /~ansaf/CING/CCLS-13-04.pdf (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002556028A3C8>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed'))`
Workaround
If we create a dummy file having the same name as the one it failed to download in the respective folder, the program skips the file and starts downloading the rest of the files. Though, such work around exists, it is my request to the author(s) to implemented what is described in the expected behavior.