search

coursera-dl / edx-dl

A simple tool to download video lectures from edx.org (and other openedx sites)
GNU Lesser General Public License v3.0
1.93k stars 638 forks source link

Cannot open edx-dl.py #384

Open vegaTwice opened 8 years ago

vegaTwice commented 8 years ago

Subject of the issue

The files are not being downloaded, there seems to be a number of exceptions

My environment

`C:\Users\ABHIJEETH>python edx-dl.py -u -p ://courses.edx.org/courses/IITBombayX/ME209x/2T2014/info edx_dl version 0.1.2 Building initial headers for future requests. Getting initial CSRF token. Found CSRF token. Logging into Open edX site: https://courses.edx.org/login_ajax Extracting course information from dashboard. Downloading Thermodynamics [IITBombayX/ME209x/2T2014] Downloading 15 section(s) Section 1: Week 1 Lecture 1: Introductory Topics Lecture 2: Basic Ideas and Definitions Lecture 3: Thermodynamic State Space Section 2: Entrance Survey Entrance Survey Section 3: Week 2 Lecture 4: The Work Interaction Lecture 5: Thermodynamic Definition of Work Lecture 6: Evaluation of Work Exercises and Quiz Solutions to Exercises A Paperwork for Weeks 1 and 2 Section 4: Week 3 Lecture 7: Introduction and History Lecture 8: The First Law Lecture 9: Introduction to the Zeroth Law Lecture 10: The Zeroth Law Section 5: Week 4 Lecture 11: Temperature Scales and Thermometry Lecture 12: Equations of State and Properties of Systems Exercises Solutions to Exercises B Quiz Lecture 13: Van der Waals Gas, Exercises Solutions to Exercises Set C-1 Quiz Paperwork for Weeks 3 and 4 Section 6: Week 5 Lecture 14: Introduction to Fluids Lecture 15 Phase Diagram of Water Lecture 16: Phase Change and Zones on PT Diagram Tutorial L16: Identify the Zone Section 7: Week 6 Lecture 17: Steam Tables and Subcooled and compressed liquid Tutorial L17: Illustrative examples based on steam tables Lecture 18: Dryness fraction Tutorial L18: Dryness fraction Exercises and Quiz 18 Lecture 19: Mollier Diagram Tutorial L19: Mollier Chart and First Law Exercises and Quiz 19B Solution to Exercises Set C-3 Section 8: Week 7 Lecture 20 : Introduction to the Second Law Lecture 21 : The Heat Engine Lecture 22 : Temperature Levels and Performance Parameters Lecture 23: Reversible Processes Quiz Section 9: Week 8 Lecture 24: The Carnot Theorem Lecture 25: Thermodynamic Temperature Lecture 26: The Carnot Cycle Lecture 27: The Clausius Inequality None Quizzes Section 10: Week 9 Lecture 29: More on Entropy Lecture 30: Evaluation of Entropy Difference Lecture 31: Problem Solving with the Second Law Lecture 32: Exercises Quizzes Paperwork for Weeks 7, 8, and 9 Section 11: Week 10 Lecture 33: Basic Property Relations Lecture 34 : Property Derivatives Lecture 35 : Maxwell's Relations and More Lecture 36 : Exercises Quizzes Paperwork for Week 10 Section 12: Week 11 Lecture 37: Introduction to Open Systems Lecture 38: Analysing Mass and Energy Balance in Open Systems Lecture 39: Analysing Second Law and Steady State in Open Systems Lecture 40: Steady State Heat and Mass Transfer Devices Lecture 41: Specific Systems Quizzes Section 13: Week 12 Lecture 42: Exercises Involving the First Law Lecture 43: Exercises Involving the Second Law and Isentropic Efficiency Lecture 44: Some Interesting Devices and Transient Problems Lecture 45: Some Other Steady Flow Devices Paperwork of Prof. Bhandarkar Section 14: Final Examination Final Examination Solutions to Final Examination Section 15: Exit Survey Exit Survey Extracting all units information in parallel. Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8956e4bf83124c078418f33c90efefb9/45bb1c9c751945a18a62df9479604248/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8956e4bf83124c078418f33c90efefb9/210d9782db434bde90dd15f68618b8bf/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/616ea534796342a0a4be977860c7d0f7/0f66ee631f8745e7a8d825ca8c812ade/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/616ea534796342a0a4be977860c7d0f7/7618c29423d048819f77d0cb73aa1778/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/616ea534796342a0a4be977860c7d0f7/7e0e0a8df96842e2a4e0e4b0f26be3a1/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/719c8291f6c0477b91fa25253b217365/f611e7550e6a4fda8c23c79be395c8e9/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/719c8291f6c0477b91fa25253b217365/b07e2d5989e54cee8b67cf652c0ea34b/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/2f6065c8badb4a2eb58247c97341a612/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/e2198b562cfb4e6ea6bd7b998a80ad73/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/3479c38fb59849d9badf8629311359b3/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/531b3edafa6c4a3fa9fc3ce25aa19dd4/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/75fd9a53937648c596d194c546c4c416/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/79416e9d1dfc433cafcd24d07d191ed5/8cb304676f1d4740ac8aaa05ff0e464d/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/79416e9d1dfc433cafcd24d07d191ed5/33e69ff2d48742d8b38b9cb021f3be5a/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/3eb5837796044e0cbda37045563ccba2/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/67c272c46a2b4ef3b888ec37c9ad8f04/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/9ff45c6344b044c6ab5c3efe26a4ea86/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/616ea534796342a0a4be977860c7d0f7/1194e47ef2fe4f1380c80fd831870ccf/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/cc241e48b9d44a89b73ed323ce80cbf4/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/35e8f478faf341a69f4e0c0ddc13d6e8/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/616ea534796342a0a4be977860c7d0f7/d53ebc1cf46748b5a89c582887e3ff99/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/7cd0c3606c06429aa9fc20f45399b197/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8956e4bf83124c078418f33c90efefb9/06bceb0042c34cff92c13a89298e36ed/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/8ac46a4bfc344afd8f24fdad19a123eb/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/69ba54a850bb45ccac1494c82d6c62db/386cd107d6c84d6783faf7423fa715cb/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/842e97b8711d4228ad3c7470303c3881/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/11d3fa4f39c14e9ea2b21e493b216b7a/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/afd309204df04de9b8070d30c3104e85/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/4d85aef42ebc4a5aab7bdb5775f20073/44894ffb05844ebab85de1d4e7328aeb/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/719c8291f6c0477b91fa25253b217365/00dbafe3b5c947608ec8820af88d0588/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/719c8291f6c0477b91fa25253b217365/004d50d1669a4040b14a32a27794f8b5/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/4d85aef42ebc4a5aab7bdb5775f20073/46bca5c5691240488774d9fae5a571f0/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/f176b63478204d64a4ad85f0ce9c46b5/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/4d85aef42ebc4a5aab7bdb5775f20073/c868fcb646ee48a29b0f07edd57b6168/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8234ffbac09d4065ab7cc504731690a4/1ffd63caa0d144b6aa01837ff401b65f/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a5377ba8f9d247759830f6cf8fd31f87/c216f691dbe24e8a8a840045ce043a2f/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/d82cd559c76e40639a9420646cdee62c/792b701115a3422c9614c78bfe96760f/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/79416e9d1dfc433cafcd24d07d191ed5/c619b004ccf5489a8d2c1978b1ee5841/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8234ffbac09d4065ab7cc504731690a4/e04bc68c92634d34bfc7a35607ecd75b/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/4d85aef42ebc4a5aab7bdb5775f20073/38c6878dc2ca4bdd86ff602c4f368e72/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8234ffbac09d4065ab7cc504731690a4/a31f5fb5a60f4664a7ce3536a45944b1/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8234ffbac09d4065ab7cc504731690a4/1213ceb004e742ceb9eb005adb24755c/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/8234ffbac09d4065ab7cc504731690a4/ab0841cbbbde42d2beedece77bee286e/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a3bed888a2994b23ae4c277c5fb6a4b3/02db61d4b66c4718aefd4468a2981f6b/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/4d85aef42ebc4a5aab7bdb5775f20073/2040c1d753d24c59a133a33d4164eb01/' Processing 'https://courses.edx.org/courses/IITBombayX/ME209x/2T2014/courseware/a3bed888a2994b23ae4c277c5fb6a4b3/e586de1a10c64c38aebc1a2b5b83c4aa/' Traceback (most recent call last): File "C:\Users\ABHIJEETH\Anaconda3\lib\http\client.py", line 561, in _readall_chunked value.append(self._safe_read(chunk_left)) File "C:\Users\ABHIJEETH\Anaconda3\lib\http\client.py", line 609, in _safe_read raise IncompleteRead(b''.join(s), amt) http.client.IncompleteRead: IncompleteRead(7690 bytes read, 2438 more expected)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "edx-dl.py", line 6, in edx_dl.main() File "C:\Users\ABHIJEETH\Anaconda3\lib\site-packages\edx_dl\edx_dl.py", line 1028, in main all_units = extractor(all_urls, headers, file_formats) File "C:\Users\ABHIJEETH\Anaconda3\lib\site-packages\edx_dl\edx_dl.py", line 467, in extract_all_units_in_parallel units = pool.map(mapfunc, urls) File "C:\Users\ABHIJEETH\Anaconda3\lib\multiprocessing\pool.py", line 260, in map return self._map_async(func, iterable, mapstar, chunksize).get() File "C:\Users\ABHIJEETH\Anaconda3\lib\multiprocessing\pool.py", line 608, in get raise self._value File "C:\Users\ABHIJEETH\Anaconda3\lib\multiprocessing\pool.py", line 119, in worker result = (True, func(_args, _kwds)) File "C:\Users\ABHIJEETH\Anaconda3\lib\multiprocessing\pool.py", line 44, in mapstar return list(map(args)) File "C:\Users\ABHIJEETH\Anaconda3\lib\site-packages\edx_dl\edx_dl.py", line 436, in extract_units page = get_page_contents(url, headers) File "C:\Users\ABHIJEETH\Anaconda3\lib\site-packages\edx_dl\utils.py", line 64, in get_page_contents return result.read().decode(charset) File "C:\Users\ABHIJEETH\Anaconda3\lib\http\client.py", line 455, in read return self._readall_chunked() File "C:\Users\ABHIJEETH\Anaconda3\lib\http\client.py", line 565, in _readall_chunked raise IncompleteRead(b''.join(value)) http.client.IncompleteRead: IncompleteRead(56972 bytes read)`

VinaySC commented 8 years ago

Even I have the same issue

abodacs commented 7 years ago

have the same issue