Prepare next edition of this course

[hannesdatta]

Structure

• [x] make 10-minute coaching sessions hybrid: moment work together rather than just meeting for 10 minutes (i.e., allocate students in breakout rooms) --> issue #107
• [ ] allow course(s) to be taken each semester (?)
• [ ] use teamviewer link/meeting rather than ID/password? issue #108
• [ ] build in quizzes so students keep up to date?
• [ ] introduce student skills pre-survey so students can make informed choices about whom to work with
• [ ] consider involving TA for more questions/feedback and running the tutorials
• [ ] #112
• [x] #111
• [ ] remove SPA

Substantive content

• [x] address use of XPATHs - good or not? when to use? Same w/ CSS selectors - introduce as proper content
• [x] find a place to address array misalignment - hierarchy of scraping in the tutorials (!)
• [ ] incorporate legal content (zyte talk)
• [ ] incorporate more details about business opportunities / e.g., even a guest lecture
• [ ] make tradeoffs in methodological framework more explicit

Technical content

• [x] #109
• [ ] consider new packages (not selenium, but the one I encountered elsewhere) -- maybe it is more stable?)
• [x] revise "link generation" in tutorials in the 101s
• [ ] remove redundancies between API tutorial and web data for dummies
• [ ] think how having APIs appear a little earlier in the course
• [ ] consider adding scrapy?

Setup of new website

• [x] update Canvas course
• [x] set new parameters for next edition of the course in config.toml
• [x] #110
• [ ] update Pulse
• [x] Consider giving bonus points to students who 'help' putting up solutions / fixing errors etc.

Assessment updates?

• [ ] cut down exam time? (odcm: just a multiple choice exam, 1.5 hours)?

[hannesdatta]

• [ ] add extracting attribute values to webscraping-for-dummies

[hannesdatta]

• [x] add array misalignment - hierarchy of scraping in the tutorials (!)
• [x] remove complicated iterators/web link building
• [x] move selenium from webscraping 101 to the very end (as a preview)

[hannesdatta]

• [ ] preview more clearly that there are multiple "ways" to extract information: text inbetween <> and values of particular attributes -- do that in the first web data tutorial