search

omareldeeb / tum-moodle-downloader

A python-built web crawler to automate file downloads off of https://www.moodle.tum.de/
29 stars 10 forks source link

Download configuration, regex support and refactoring #3

Closed romman8 closed 4 years ago

romman8 commented 4 years ago

Hi Omar, here is Roman.

A brief overview over the changes me and Mai made (more details in the commits):

  1. Refactored the argument parsing using argparse (also changed the interface doing so --> see Readme)
  2. Password is not stored in plain text in the credentials file anymore unless the user choses to put it there on his own
  3. Made the download configurable via a json config file (see Readme for details). This also allows to give patterns (regex) for the filenames that are to be downloaded)
  4. Implemented a rudimentary handling for the case that the file already exists in the destination directory
  5. Added support for lectures structured by topics rather than weeks (there are still some exotic unsupported formats though --> see issues)
  6. Refactored the code
  7. Identified some bugs and possible improvements (see issues in my repository)