Trying to scrape DTU course description

isdsucph / isds2024

Introduction to Social Data Science 2024 - a summer school course https://isdsucph.github.io/isds2024/

MIT License

13 stars 7 forks source link

Trying to scrape DTU course description #7

Open Oliver-Laursen opened 4 weeks ago

Oliver-Laursen commented 4 weeks ago

I'm trying to scrape https://kurser.dtu.dk/course/2022-2023/01001 and all the other courses for DTU.

However, I'm stuck at getting the info from the page, I want to loop through all the courses and return the following:

Course name
Language
Course type (MSc or BSc)
Professor name
Institue

So if anyone have done something similar or just know a way around then I would love to hear it. PS: It's a dynamic web page so it isn't possible to use BeautifulSoup so I'm using Selenium for it

abjer commented 3 weeks ago

Dear Oliver. Hope you found an answer to this. Otherwise try to bring it up in your supervision today.

Cheers Andreas