FliegendeWurst / KIT-ILIAS-downloader

Downloader for https://ilias.studium.kit.edu/
GNU General Public License v3.0
42 stars 9 forks source link

Add crawler for KIT websites like IPD #20

Open probstlukas opened 3 years ago

probstlukas commented 3 years ago

Many KIT lectures do not use ILIAS to make the files available to students. Instead, they use the websites of their institutes. A prominent example is "Programmierparadigmen" with https://pp.ipd.kit.edu/lehre/WS202122/paradigmen/ and https://pp.ipd.kit.edu/lehre/WS202122/paradigmen/uebung/ (for the current semester). It would be practical to be able to set this up in a config file and obtain all files via the KIT-ILIAS downloader.

funnym0nk3y commented 3 years ago

In addition a crawler for the lecture recording platform of the KIT library would be nice.

funnym0nk3y commented 2 years ago

@thelukasprobst From "normal" websites that don't hide the download link behind some PHP or JS I can recommend browser extensions like DownThemAll or DownloadStar. This does not sync the files constantly but is useful for archiving the files. Also: Have a look at PFERD, which has this capability already.

The download of videos from KIT library (DIVA) works with youtube-dl via RSS ingestion. Usually lecture series are grouped and a RSS feed can be downloaded via

grafik

Shove that xml file into youtube-dl and voilà.