This PR includes the initial implementation of the courses scraper, as well as the models that store it. It also includes tests for all of this functionality (as per #5). In addition, it includes the initial project structure.
What it does not include, however, is:
an exposed API for this information
any standard API functionalities (rate-limiting, authorization, etc.)
execution of tasks defined (this happens by a global scheduler)
The main work that needs to be reviewed (and has not been reviewed already) is under pdata/courses/data.py and pdata/courses/tests. The models (pdata/courses/models.py) have already been reviewed in #7 and the rest is just configuration that was reviewed previously in dev (#2 and #6).
This PR includes the initial implementation of the courses scraper, as well as the models that store it. It also includes tests for all of this functionality (as per #5). In addition, it includes the initial project structure.
What it does not include, however, is:
The main work that needs to be reviewed (and has not been reviewed already) is under
pdata/courses/data.pyandpdata/courses/tests. The models (pdata/courses/models.py) have already been reviewed in #7 and the rest is just configuration that was reviewed previously indev(#2 and #6).