processing but cannot download the videos

ymjxuerong commented 4 years ago

🚨Please review the Troubleshooting section before reporting any issue. Don't forget also to check the current issues to avoid duplicates.

Subject of the issue

Hello, I didn't encounter any problem until the last line when I try to download the videos through the URLs. I am using a proxy in China, with the "automatic proxy" setting.

And it never actually download the videos

Your environment

Operating System (name/version): Mac OS Catalina 10.15.5
Python version: 3.6
youtube-dl version: latest
edx-dl version:latest

Steps to reproduce

This is the course I tried to download : Product Management Fundamentals [course-v1:USMx+ENES608.1+2T2020/co] https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/course/

Expected behaviour

keep processing....

Actual behaviour

tugloo1 commented 4 years ago

I was able to download them. Well most of them. A couple of the videos didn't get downloaded.

Downloading Product Management Fundamentals [course-v1:USMx+ENES608.1+2T2020/co] Downloading 5 section(s) Section 1: Module 1: Welcome to Product Management Fundamentals Overview Connect with Your Classmates Expand Your Learning Section 2: Module 2: Roles and Responsibilities of the Product Manager Introduction What Do Product Managers Do? Product vs Project vs Program How to Become a Product Manager Types of Product Managers The Product-Development Life Cycle Product Spotlight: Sharetribe Challenge Question Quiz: Roles and Responsibilities of the Product Manager Section 3: Module 3: Managing Innovative Product Teams Introduction Organizing and Managing a Product Team Working with Business Working with Design Working with Engineering Challenge Question Quiz: Managing Innovative Product Teams Section 4: Module 4: Market Development and Commercialization Introduction Marketing Challenges Customer Development Crossing the Chasm Challenge Question Quiz: Market Development and Commercialization Section 5: Next Steps Next Steps Extracting all units information in parallel. Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@12c2021b623e469c9a21622b65b7e0da' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@18be4479c73b4fe9a3e71a4e5969e5e4' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@1f0febc7d0d140aeb7590c099116c146' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@c18d4011c4f645e69321d4f69a600e00' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@9def6a98bd71426f9c7fd0863be79e2c' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@e66242d02f944d15b8aeecfe4be44399' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@19e8b69ad8ed49c7b49b8a7dff710005' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@aa961c20bd344c27a288d8c2617c7a50' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@37b953f96cad400d9cc68848f3683852' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@307c335daff4491494adc1474b1780d0' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@58bc65524e1d4840bd0c06598d8f260a' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@2b675208040e4a4f9ae53b932fbcac5b' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@6a8a2f1b99ee492e9e72c2cf2713d448' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@bdf67b6885c44f4ab9031074082a5d47' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@27e5ab76fbab455b9afa346369ceb886' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@78620d7521b545cfa4d88f6fbed361d6' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@a94e58e533294d2cbd8d89771ec21b66' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@44e8e0794cc8473181d742cffd6c92d2' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@1877071b85f44d9abb91892cc81c9369' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@622e38164d9646a6847503433dfbdc89' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@9cb8404f1a644a09bbef313ad3e71cff' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@f7fa50338ca14592886484cc43b264ca' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@15ff06c5272844d3a09a2ee2a011b7e4' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@50a54c9b0a954532a7f4313ea4768bec' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@8abcfbee5f3e40dfb48d7dd71ceb16c2' Processing 'https://courses.edx.org/courses/course-v1:USMx+ENES608.1+2T2020/jump_to/block-v1:USMx+ENES608.1+2T2020+type@sequential+block@2605024339814c80805367e1d0ffd957' Removed 34 duplicated urls from 140 in total Output directory: Downloaded [download] https://edx-video.net/USMxENES608.1-V003600_DTH.mp4 => Downloaded/Product_Management_Fundamentals/01-Module_1-_Welcome_to_Product_Management_Fundamentals/01-USMxENES608.1-V003600_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004900_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/01-USMxENES608.1-V004900_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V000300_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/02-USMxENES608.1-V000300_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V000400_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/03-USMxENES608.1-V000400_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V000700_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/04-USMxENES608.1-V000700_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V000800_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/05-USMxENES608.1-V000800_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V001200_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/06-USMxENES608.1-V001200_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V001100_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/07-USMxENES608.1-V001100_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V001400_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/08-USMxENES608.1-V001400_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V001000_DTH.mp4 => Downloaded/Product_Management_Fundamentals/02-Module_2-_Roles_and_Responsibilities_of_the_Product_Manager/09-USMxENES608.1-V001000_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V005100_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/01-USMxENES608.1-V005100_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V001700_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/02-USMxENES608.1-V001700_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V001800_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/03-USMxENES608.1-V001800_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V001900_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/04-USMxENES608.1-V001900_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002000_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/05-USMxENES608.1-V002000_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002100_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/06-USMxENES608.1-V002100_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002200_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/07-USMxENES608.1-V002200_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002300_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/08-USMxENES608.1-V002300_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002400_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/09-USMxENES608.1-V002400_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002500_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/10-USMxENES608.1-V002500_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002600_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/11-USMxENES608.1-V002600_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V002900_DTH.mp4 => Downloaded/Product_Management_Fundamentals/03-Module_3-_Managing_Innovative_Product_Teams/12-USMxENES608.1-V002900_DTH.mp4 [skipping] https://edx-video.net/USMxENES608.1-V005000_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/01-USMxENES608.1-V005000_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004200_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/02-USMxENES608.1-V004200_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V003900_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/03-USMxENES608.1-V003900_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V003700_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/04-USMxENES608.1-V003700_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004100_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/05-USMxENES608.1-V004100_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004700_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/06-USMxENES608.1-V004700_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004800_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/07-USMxENES608.1-V004800_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004400_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/08-USMxENES608.1-V004400_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004600_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/09-USMxENES608.1-V004600_DTH.mp4 [download] https://youtube.com/watch?v=3_yD_cEKoCk => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/10-%(title)s-%(id)s.%(ext)s Downloading video with URL https://youtube.com/watch?v=3_yD_cEKoCk from YouTube. [youtube] 3_yD_cEKoCk: Downloading webpage [download] Destination: Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/10-edX – How It Works-3_yD_cEKoCk.mp4 [download] 100% of 15.56MiB in 00:06 [download] https://edx-video.net/USMxENES608.1-V004300_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/11-USMxENES608.1-V004300_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V004000_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/12-USMxENES608.1-V004000_DTH.mp4 [download] https://edx-video.net/USMxENES608.1-V003800_DTH.mp4 => Downloaded/Product_Management_Fundamentals/04-Module_4-_Market_Development_and_Commercialization/13-USMxENES608.1-V003800_DTH.mp4

The ones with "skipped" is because I ran this twice and it didn't pick up all the videos on the first pass but I have most of them on my laptop now.

NickCarraway96 commented 4 years ago

Same here. No error message encountered, but videoes weren't downloaded.

ruychi commented 4 years ago

Same here, in macOS 10.15.6, python 3.6.11, python 3.7.7, modified line 425 of edx-dl.py to 'User-Agent': 'Mozilla/5.0', processes all, without errors but nothing gets downloaded:

MarwanShehata commented 4 years ago

Same here

edx_dl version 0.1.13
Building initial headers for future requests.
Getting initial CSRF token.
Found CSRF token.
Logging into Open edX site: https://courses.edx.org/login_ajax
Extracting course information from dashboard.
Downloading Fundamentals of Technical Analysis [course-v1:NYIF+ITA.PC1x+2T2020/co]
Downloading 7 section(s)
Section  1: Welcome to the Course
  Introduction to the edX Platform
  About the Professional Certificate
  About this Course
Section  2: Background and Charts
  Overview and Objectives
  M01: Background and Basics
  M02: Why Technical Analysis Works
  M03: Constructing and Interpreting Charts
  M04: Chart Patterns
Section  3: Practical Technical Theories
  Overview and Objectives
  M05: Introduction to Technical Indicators
  M06: Testing Technical Indicators
  M07: Relative Strength
  MO8: Technical Theories
  M09: Psychology of Trading
Section  4: Final Exam
  Final Exam
Section  5: Key Takeaways
  Key Takeaways
Section  6: Course End Survey
  Course End Survey
Section  7: Community Recommendation
  Community Recommendation
Extracting all units information in parallel.
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@37f75c4d16fa45c884ec8918042296b2'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@ae5cf14a98df418e91e7c6b4357f0c77'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@ec921f832f2a409c838a335f48545daf'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@25ca15c0e8b24cab925b6abc0d848274'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@9a45ecea0f4e450f8932dc9b199f494a'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@b9f985ea04a340ad92fe5e4bae324669'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@f188b6d9e6a94c329586ea628b5d731c'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@3105e8efd3b7411ba13ba9c10c7cde73'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@9265be5288c848da9f7ebba8106403b4'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@8daf23fea5184c0c88b68d628feb4544'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@d4586b3489b84a87ab0491722be09cdc'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@577b12b341594f5f8fdce41908f7174d'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@f6381a149a7344968e7a319862d50bf7'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@7926978a9e3f4993a1e480592807cccd'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@8d7fdebe84ac4e4dab09877e631c2b10'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@ba60f6b82a104300b49d13635123fd2f'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@07798bd62a21453cbb02b58e911ad79d'
Processing 'https://courses.edx.org/courses/course-v1:NYIF+ITA.PC1x+2T2020/jump_to/block-v1:NYIF+ITA.PC1x+2T2020+type@sequential+block@d9f5db150b8c4b7c8e792f571333e26e'
Removed 0 duplicated urls from 0 in total
Output directory: Downloaded

millsio commented 4 years ago

Same here.

I also followed #631 and changed line 425 of edx-dl.py to 'User-Agent': 'Mozilla/5.0' to address the 403 response. The second execution is after making the following changes from #587 :

--- a/edx_dl/parsing.py
+++ b/edx_dl/parsing.py
@@ -382,13 +382,13 @@ class NewEdXPageExtractor(CurrentEdXPageExtractor):

         def _make_subsections(section_soup):
             try:
-                subsections_soup = section_soup.select("li.vertical.outline-item.focusable")
+                subsections_soup = section_soup.select("li.subsection")
             except AttributeError:
                 return []
             # FIXME correct extraction of subsection.name (unicode)
             subsections = [SubSection(position=i,
                                       url=s.a['href'],
-                                      name=s.a.div.div.string.strip())
+                                      name=s.a.h4.string.strip())
                            for i, s in enumerate(subsections_soup, 1)]

C:\Users\XXXXX>edx-dl -u XXXXX@gmail.com https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/course/
edx_dl version 0.1.13
Password:
Building initial headers for future requests.
Getting initial CSRF token.
Found CSRF token.
Logging into Open edX site: https://courses.edx.org/login_ajax
Extracting course information from dashboard.
Downloading Developing a Multidimensional Data Model [course-v1:Microsoft+DAT224x+2T2018/co]
Downloading 7 section(s)
Section  1: Module 0 | Course Introduction
Section  2: Module 1 | Introduction to Analysis Services
Section  3: Module 2 | Designing Multidimensional Models
Section  4: Module 3 | Managing Multidimensional Models
Section  5: Module 4 | Making Architectural Decisions
Section  6: Module 5 | Final_Exam
Section  7: Module 6 | PostCourseSurvey
Extracting all units information in parallel.
Removed 0 duplicated urls from 0 in total
Output directory: Downloaded

C:\Users\XXXXX>edx-dl -u XXXXX@gmail.com https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/course/
edx_dl version 0.1.13
Password:
Building initial headers for future requests.
Getting initial CSRF token.
Found CSRF token.
Logging into Open edX site: https://courses.edx.org/login_ajax
Extracting course information from dashboard.
Downloading Developing a Multidimensional Data Model [course-v1:Microsoft+DAT224x+2T2018/co]
Downloading 7 section(s)
Section  1: Module 0 | Course Introduction
  Before You Start
  Welcome
  Pre-Course Survey
  Survey Acknowledgement
  Hands On Lab Environment
Section  2: Module 1 | Introduction to Analysis Services
  Introducing Analysis Services
  Developing Multidimensional Models
  Connecting to Source Data
  Lab 1
  Resources
  Module Assessment
                                          (2 Questions)
Section  3: Module 2 | Designing Multidimensional Models
  Developing Dimensions
  Developing Cubes
  Enhancing Cubes with Business Logic
  Lab 2
  Resources
  Module Assessment
                                          (2 Questions)
Section  4: Module 3 | Managing Multidimensional Models
  Managing Multidimensional Databases
  Resources
  Lab 3
  Module Assessment
                                          (2 Questions)
Section  5: Module 4 | Making Architectural Decisions
  Comparing Tabular and Multidimensional Models
  Putting It All Together
  Lab 4
  Resources
  Module Assessment
                                          (2 Questions)
Section  6: Module 5 | Final_Exam
  Final Exam
                                          (10 Questions)
Section  7: Module 6 | PostCourseSurvey
  Post-Course Survey
  Survey Acknowledgement
Extracting all units information in parallel.
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@66b63cbbd51e403e9b97f5bc5d960ac1'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@192354ada78f4d2385b564c4064eeb4b'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@05dbe5754df24918a2d924b6a6d5e48b'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@65d46ee1c8384defb78f2e9358f113c9'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@cfc75be3dfe84e03b6687832a98aca16'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@64d7e1feebc646b29b51281e53a3f381'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@b98b5b9a0a39487f8ce9fbf1ed9b199e'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@aede7678728e4107b979c8aea91eea9a'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@f70662b9d4984c4180442f9a16ec8604'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@84830ff7cb9548a8aff3175290d4f44d'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@7042564519d847c89dfe91c88b78e287'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@0db84cfe8e4c47be89da468e3cfc228b'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@8537941a2a094cd1b1d1803ed376c3ce'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@7fd5dfca4ec74accb7570d6d82a34bfe'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@818a3850a9494cd0aa5bbab6255d3ba5'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@83a8dd089d3743219492032e00532780'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@069c19b8a4994a38bd63def03f356fde'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@f139ced8ef774b98ae90b6728b1fa74b'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@f7e2936acde245adb9504ae43256b69c'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@7745865a689b434ea8a60575a93cca99'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@ec3746f4c59846c48fb945a0074ef498'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@531d58befcd34763959136d102cd7e32'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@a93c7724203443df8a8890554444bef5'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@0d19d99569784d328b15404a85e6d9b0'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@8d8b8b8c4080460e9a287663e10676ef'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@e473fce1db134938adf05162a2de53b4'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@8d06b7cd56fd4ee0bb31e055cd513699'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@d4f69b535ffd4b9d964796850a27aad1'
Processing 'https://courses.edx.org/courses/course-v1:Microsoft+DAT224x+2T2018/jump_to/block-v1:Microsoft+DAT224x+2T2018+type@sequential+block@b06df26ecb3a4eba90463d70a02d2c2b'
Removed 0 duplicated urls from 0 in total
Output directory: Downloaded

shad90 commented 4 years ago

OK, So i am having the same problem. All solutions previously mentioned are not working. I think problem lies with edx-video.net edx-dl is trying to find youtube videos but links under videos show edx-video.net site. like this https://edx-video.net/HKTELEC1/HKTELEC1T115-V017000_DTH.mp4 Can it be the problem.

Only getting Directory structure but no material.

andrija-tosic commented 4 years ago

@piyushg91, how did it work for you, but not for the rest of us?

Radar-Lei commented 4 years ago

same here

crazy-logic commented 4 years ago

OK, So i am having the same problem. All solutions previously mentioned are not working. I think problem lies with edx-video.net edx-dl is trying to find youtube videos but links under videos show edx-video.net site. like this https://edx-video.net/HKTELEC1/HKTELEC1T115-V017000_DTH.mp4 Can it be the problem.

Only getting Directory structure but no material.

Same here. and can confirm if i manually look at the code fro a string with .mp4 I can then download that video just fine.

millsio commented 4 years ago

...very cool courses btw.

pavitrashah commented 4 years ago

Same here. I'm also facing this issue.

Learnpython-code commented 3 years ago

Hello everyone, I am new with python, Please help checking my results, I dont got any videos , only folders empty.

Result

C:\edx-dl-master>python edx-dl.py -u (username) https://courses.edx.org/courses/coursev1:URosarioX+URX01+1T2020/course/ edx_dl version 0.1.13 Password: Building initial headers for future requests. Getting initial CSRF token. Found CSRF token. Logging into Open edX site: https://courses.edx.org/login_ajax Extracting course information from dashboard. Downloading Diseño de sistemas de información gerencial para intranet con Micros oft Access [course-v1:URosarioX+URX01+1T2020/co] Downloading 5 section(s) Section 1: Generalidades Acerca del curso Section 2: Microsoft Access y Bases de Datos Relacionales Conceptos básicos Planear y crear una BDR Evaluación Section 3: Diseño de la interface - Consultas Visualizar información Modificar la BDR con consultas de acción Interacción con otros programas Evaluación Section 4: Diseño de la interface - Formularios y macros Ingresar datos a la BDR Panel de control personalizado Evaluación Section 5: Diseño de la interface - Informes Informes Evaluación Cierre Extracting all units information in parallel. Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@ddbbb4394e4f4eeab5716 95c19842fc2' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@edcc3663b92546ee9f37d 4868d05ba30' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@7a917180012346c8b7f1d e5837729bbd' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@fdb672aa18b0485aa6954 19f493a5fd0' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@5b34eb36e50a4db6a9c4c 53e719546cf' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@c78e301110b54cff8a850 0c784e16d09' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@fcd257068abb4f588805d b3a15e0ba06' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@9205182f4d2b46ec93fd6 ff22d752fa6' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@f9a2c97a613a40169a016 67bb6aca2be' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@30549607116847379bc57 b4419084652' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@09f8ee9e3295491495749 4d87da8a4bc' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@674fda5e810440f190d84 9740e674cae' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@fe847e5e361b47a3a3efd 82f480b2a4e' Processing 'https://courses.edx.org/courses/course-v1:URosarioX+URX01+1T2020/jum p_to/block-v1:URosarioX+URX01+1T2020+type@sequential+block@29c2dfb8e8294eed941ee 3b576db59c8' Removed 0 duplicated urls from 0 in total Output directory: Downloaded

coursera-dl / edx-dl