coursera-dl / edx-dl

A simple tool to download video lectures from edx.org (and other openedx sites)
GNU Lesser General Public License v3.0
1.92k stars 638 forks source link

there's one video that is not available on youtube so the course stops downloading #609

Open HM-Ilahi opened 4 years ago

HM-Ilahi commented 4 years ago

Please review the Troubleshooting section before reporting any issue. Don't forget also to check the current issues to avoid duplicates.

This video is unavailable.

there's one video that is not available on youtube so the course stops downloading. is there any way that I skip the videos which are not available and download the rest of the course. or there's ERROR GITHUB a solution to download the completed course?

Your environment

Steps to reproduce

https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/course/

Expected behavior

Download the full course. ERROR GITHUB

Actual behavior

Building initial headers for future requests. Getting initial CSRF token. Found CSRF token. Logging into Open edX site: https://courses.edx.org/login_ajax Extracting course information from dashboard. Downloading Robotics Foundations I - Robot Modeling [course-v1:FedericaX+50+1T2020b/co] Downloading 8 section(s) Section 1: Week 1 Lesson 1 - Introduction to Robotics Lesson 2 - Industrial Robotics and Advanced Robotics Section 2: Week 2 Lesson 3 - Representation of Orientation Lesson 4 - Direct Kinematics Section 3: Week 3 Lesson 5 - Inverse Kinematics Section 4: Week 4 Lesson 6 - Jacobian Midterm Exam Section 5: Week 5 Lesson 7 - Differential Kinematics Section 6: Week 6 Lesson 8 - Inverse Kinematics Algorithms Section 7: Week 7 Lesson 9 - Statics Lesson 10 - Lagrange Formulation Section 8: Week 8 Lesson 11 - Use of Dynamic Model Lesson 12 - Newton-Euler Formulation Final Exam Extracting all units information in parallel. Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@b2afd91824394474a1c95da8ecb7f446' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@8d5f3a229c8643bea30b137778d6a5b8' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@d176680cc00f491588ba58773d6ead7b' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@fb2ca1be21fa4795b8110b2745ceb789' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@7f9a32d44f43487882a854b7e960365e' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@d57a102e465341948283413fa6b42868' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@7c21131fa0ff4fae843f7a07abaecc59' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@17b93481ab234203a2d730313ff3e241' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@b80345c15fa245ddb850cd379fa408fc' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@7ca03a5ec05147178fba97aefd5d7a51' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@6a50931953cb4561aa435c21022e0e3f' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@f84138b32d7b4152adb999e5eec4733b' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@b0a312eeb066443198fe7edaee7f380c' Processing 'https://courses.edx.org/courses/course-v1:FedericaX+50+1T2020b/jump_to/block-v1:FedericaX+50+1T2020b+type@sequential+block@de55540d1f92401c8c2786a56683aad5' Removed 0 duplicated urls from 111 in total Output directory: Downloaded [skipping] https://edx-video.net/FedericaX50-V000200_DTH.mp4 => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\01-FedericaX50-V000200_DTH.mp4 [download] https://www.youtube.com/watch?v=tTxdYViHnmI => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\02-%(title)s-%(id)s.%(ext)s Downloading video with URL https://www.youtube.com/watch?v=tTxdYViHnmI from YouTube. [youtube] tTxdYViHnmI: Downloading webpage [download] Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\02-SMErobot™ Coffee Break (English)-tTxdYViHnmI.mp4 has already been downloaded [download] 100% of 18.95MiB [skipping] https://edx-video.net/FedericaX50-V000100_DTH.mp4 => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\03-FedericaX50-V000100_DTH.mp4 [skipping] https://edx-video.net/FedericaX50-V000300_DTH.mp4 => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\04-FedericaX50-V000300_DTH.mp4 [skipping] https://edx-video.net/FedericaX50-V000700_DTH.mp4 => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\05-FedericaX50-V000700_DTH.mp4 [download] https://www.youtube.com/watch?v=R6pPwP3s7s4 => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://www.youtube.com/watch?v=R6pPwP3s7s4 from YouTube. [youtube] R6pPwP3s7s4: Downloading webpage [download] Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\06-Rollin' Justin Robot Catches Balls Tossed in its Direction-R6pPwP3s7s4.mp4 has already been downloaded [download] 100% of 7.88MiB [download] https://www.youtube.com/watch?v=fqujpiJ0u2w => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://www.youtube.com/watch?v=fqujpiJ0u2w from YouTube. [youtube] fqujpiJ0u2w: Downloading webpage [download] Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\06-Robot Catching Balls-fqujpiJ0u2w.mp4 has already been downloaded [download] 100% of 3.61MiB [download] https://www.youtube.com/watch?v=93WHRSKg3gE => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\06-%(title)s-%(id)s.%(ext)s Downloading video with URL https://www.youtube.com/watch?v=93WHRSKg3gE from YouTube. [youtube] 93WHRSKg3gE: Downloading webpage [download] Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\06-DLR's Agile Justin plays catch with Rollin' Justin-93WHRSKg3gE.mp4 has already been downloaded [download] 100% of 2.28MiB [skipping] https://edx-video.net/FedericaX50-V000600_DTH.mp4 => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\07-FedericaX50-V000600_DTH.mp4 [download] https://www.youtube.com/watch?v=S5AnWzjHtWA => Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\08-%(title)s-%(id)s.%(ext)s Downloading video with URL https://www.youtube.com/watch?v=S5AnWzjHtWA from YouTube. [youtube] S5AnWzjHtWA: Downloading webpage ERROR: S5AnWzjHtWA: YouTube said: This video is unavailable. Sorry about that. Traceback (most recent call last): File "c:\users\hafiz\anaconda\lib\runpy.py", line 193, in _run_module_as_main "main", mod_spec) File "c:\users\hafiz\anaconda\lib\runpy.py", line 85, in _run_code exec(code, run_globals) File "C:\Users\hafiz\Anaconda\Scripts\edx-dl.exe__main__.py", line 7, in File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\edx_dl.py", line 1073, in main download(args, selections, filtered_units, headers) File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\edx_dl.py", line 850, in download headers) File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\edx_dl.py", line 822, in download_unit skip_or_download(res_downloads, headers, args) File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\edx_dl.py", line 781, in skip_or_download f(url, filename, headers, args) File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\edx_dl.py", line 707, in download_url download_youtube_url(url, filename, headers, args) File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\edx_dl.py", line 754, in download_youtube_url execute_command(cmd, args) File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\utils.py", line 42, in execute_command raise e File "c:\users\hafiz\anaconda\lib\site-packages\edx_dl\utils.py", line 37, in execute_command subprocess.check_call(cmd) File "c:\users\hafiz\anaconda\lib\subprocess.py", line 363, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['youtube-dl', '--ignore-config', '-o', 'Downloaded\Robotics_FoundationsI-_Robot_Modeling\01-Week_1\08-%(title)s-%(id)s.%(ext)s', '-f', 'mp4', 'https://www.youtube.com/watch?v=S5AnWzjHtWA']' returned non-zero exit status 1.

hlevy99 commented 4 years ago

i am getting the same error as well. Using linux python edx-dl.py -u me@gmail.com -p Password!! https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/course/ edx_dl version 0.1.13 Building initial headers for future requests. Getting initial CSRF token. Found CSRF token. Logging into Open edX site: https://courses.edx.org/login_ajax Extracting course information from dashboard. Downloading Data Science: Inference and Modeling [course-v1:HarvardX+PH125.4x+1T2020/co] Downloading 9 section(s) Section 1: Introduction and Welcome Introduction and Welcome 0.1 Important Pre-Course Survey Section 2: Section 1: Parameters and Estimates Section 1 Overview Parameters and Estimates Section 3: Section 2: The Central Limit Theorem in Practice Section 2 Overview Central Limit Theorem in Practice Section 4: Section 3: Confidence Intervals and p-Values Section 3 Overview Confidence Intervals and p-Values Section 5: Section 4: Statistical Models Section 4 Overview Statistical Models Section 6: Section 5: Bayesian Statistics Section 5 Overview Bayesian Statistics Section 7: Section 6: Election Forecasting Section 6 Overview Election Forecasting Section 8: Section 7: Association Tests Section 7 Overview Association Tests Section 9: Course Wrap-up and Comprehensive Assessment: Brexit Comprehensive Assessment: Brexit Post-Course Survey Extracting all units information in parallel. Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@e67d090f84394e5fa5f1e2c8757641c1' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@f660fd0e7aa94d36a60c135bea1c9ff8' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@634cc01c259f4bf4abf763e9e10f665e' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@c9749ffd72024a0aa751160172a5fc21' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@ab5dbaa1c2524e19807fe8671136b3ff' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@04475263a24d4d70a89c6b8e05fdc937' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@fdd5a2d2b48145f0be296f8c45f9762f' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@c1cbebe9d71f4523b32f396fa8321121' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@8f0c614e25314ce9b902097da971b91f' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@41db541539a14baab374ae183757e3c1' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@09909f5cfade494cbc967b808d540ea4' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@81aaa84910454cda8db17816ca2cca66' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@f7c01df2008e42a5bf91d841e2f9b135' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@40d856e94edb4be2a7241815b1ccc8d1' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@17f6e3e0b16741729b8990a8ada261e8' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@3bf35f2ba9824ea1854ad4b6f1759189' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@9801d0b3b75f44349075d78550b45b81' Processing 'https://courses.edx.org/courses/course-v1:HarvardX+PH125.4x+1T2020/jump_to/block-v1:HarvardX+PH125.4x+1T2020+type@sequential+block@4a271bc97b71442e972454c02c4ffd2c' Removed 0 duplicated urls from 94 in total Output directory: Downloaded [skipping] https://edx-video.net/HarvardXPH125.4x-V000300_DTH.mp4 => Downloaded/Data_Science-_Inference_and_Modeling/01-Introduction_and_Welcome/01-HarvardXPH125.4x-V000300_DTH.mp4 [skipping] https://edx-video.net/HAR787B22017-V000500_DTH.mp4 => Downloaded/Data_Science-_Inference_and_Modeling/01-Introduction_and_Welcome/01-HAR787B22017-V000500_DTH.mp4 [download] http://youtu.be/Icawuhf0Yqo => Downloaded/Data_Science-_Inference_and_Modeling/01-Introduction_and_Welcome/02-%(title)s-%(id)s.%(ext)s Downloading video with URL http://youtu.be/Icawuhf0Yqo from YouTube. Traceback (most recent call last): File "edx-dl.py", line 8, in edx_dl.main() File "/home/linuxlite/edx-dl-master/edx_dl/edx_dl.py", line 1073, in main download(args, selections, filtered_units, headers) File "/home/linuxlite/edx-dl-master/edx_dl/edx_dl.py", line 850, in download headers) File "/home/linuxlite/edx-dl-master/edx_dl/edx_dl.py", line 822, in download_unit skip_or_download(res_downloads, headers, args) File "/home/linuxlite/edx-dl-master/edx_dl/edx_dl.py", line 781, in skip_or_download f(url, filename, headers, args) File "/home/linuxlite/edx-dl-master/edx_dl/edx_dl.py", line 707, in download_url download_youtube_url(url, filename, headers, args) File "/home/linuxlite/edx-dl-master/edx_dl/edx_dl.py", line 754, in download_youtube_url execute_command(cmd, args) File "/home/linuxlite/edx-dl-master/edx_dl/utils.py", line 37, in execute_command subprocess.check_call(cmd) File "/usr/lib/python2.7/subprocess.py", line 185, in check_call retcode = call(*popenargs, *kwargs) File "/usr/lib/python2.7/subprocess.py", line 172, in call return Popen(popenargs, **kwargs).wait() File "/usr/lib/python2.7/subprocess.py", line 394, in init errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1047, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory  linuxlite  ~  edx-dl-master 