sholiday / desire2download

Download all of the content from the University of Waterloo's Desire2Learn LMS
http://stephenholiday.com/desire2download/
Apache License 2.0
29 stars 23 forks source link

Update D2D for the Learn breaking changes #12

Closed asvoboda closed 10 years ago

asvoboda commented 10 years ago

Some Notes:

sholiday commented 10 years ago

Hey,

Thanks so much!

Here's what I'm getting when I run it:

python d2d.py      
Username: scholida
Password: 
Logging In...
Logged In
Finding courses...
ECE 409 - Winter 2014
 + ECE 409 - Winter 2014/Course outline/outline_2014.pdf
 + ECE 409 - Winter 2014/Course outline/Readings from Understanding Cryptography.pdf
 + ECE 409 - Winter 2014/Course outline/cryptonotes_2014.pdf
 + ECE 409 - Winter 2014/Course outline/video assignment 1.pdf
 + ECE 409 - Winter 2014/Course outline/ECE409 Assignments.pdf
 + ECE 409 - Winter 2014/Course outline/Vigenere Cipher Challenge.pdf
 + ECE 409 - Winter 2014/Course outline/Video assignment 2.pdf
 + ECE 409 - Winter 2014/Course outline/Tutorial1_soln.pdf
ECE 406 - Winter 2014
Failed to load course: invalid literal for int() with base 10: 'A'
ECE 400B - Winter 2014
 + ECE 400B - Winter 2014/Course information/Course outline.pdf
ECE 404/PHYS 256 - Winter 2014
Failed to load course: 'NoneType' object has no attribute 'group'
ECE 498B - Winter 2014
Failed to load course: 'NoneType' object has no attribute 'group'

I'm sorry that I can't look into it too much more right now :(

asvoboda commented 10 years ago

Hm. I'm currently running this with Python 2.7.4. I'll look more into this.

Additionally, do those courses failing have documents to download?

asvoboda commented 10 years ago

Those 'Failed to load course: invalid literal for int() with base 10: 'A' seem to be problems when mechanize tries to open a url and read the response. I'm not noticing a problem on Windows, but I do see it occur on Ubuntu 12.04.

KartikTalwar commented 10 years ago

Its working fine for me :+1:

sholiday commented 10 years ago

I can't devote the time to desire2download that it deserves. I talked with Kartik and he now has contributor access and will be taking over from me.

Yes, those courses have documents that are not being downloaded.

Since we don't really have a working solution anyway, it might make sense to merge this and figure it out after. Up to you guys!

Thanks again for the pull request!

asvoboda commented 10 years ago

I believe for the most part this is now working. I'd be in favour of merging it and seeing how it works with other course documents in the wild and go from there, as @sholiday pointed out.

KartikTalwar commented 10 years ago

@sholiday thanks for the contributor access! @asvoboda I believe it makes sense to merge this for now and open up other issues for the special cases. I personally tried it with the courses I'm enrolled in this term and got all the files downloaded nicely. We can tackle the rest one issue at a time