Data Modeling 2021 (DIS08)
Slides and online lecture archive
All lectures will be hosted on Zoom: https://th-koeln.zoom.us/j/81513492081. The password for Zoom is the ZIP code of TH Köln @ Claudiusstraße 1. Lectures will be recorded and archived for later referal.
The following slide sets and videos are available. The password for the videos is the same as for the Zoom room.
- 01 Introduction, Markdown [pdf] [video] [tutorial for gitbash and repository]
- 02 The Unix Shell [pdf] [video]
- 03 Version Control with Git and GitHub [pdf] [video]
- 04 RegEx [pdf] [video]
- 05 Common Data Formats [pdf] [video]
- 06 Open Data and the Tidy Data Principle [pdf] [video] [tutorial: Assignment Questions and Help]
- 07 Python - Basic Data Processing [pdf] [notebook] [video]
- 08 Python - Files/CSV and Pandas [notebook-1] [notebook-2] [pdf] [video]
- 09 Python - Web Scraping [notebook] [video] [tutorial: Assignment 1 review]
- 10 Python - Error Handling [notebook] [video] [tutorial: Assignment 2 Help and Feedback Assignment 1 Review]
Additional materials
- How to clean up Git mess - Handy flowchart about how you can get out of some git mess
- Git cheat sheet - The most important and commonly used Git commands for easy reference
- Sample data for Shell and RegEx testing
Assignments
You are expected to work on one exercise per week that are compiled into 2 big assignments over the semester. Compile all your results into your GitHub repository. We will gather all your results from your repositories on the day of the submission deadlines. You are not required to send anything directly to us.
- Assignment 1 (personal)
- Assignment 2 (group)
- Final results of Assignment 1 and 2 (password-protected)
Open questions and FAQ in the GitHub discussion forum
Please feel free to comment on all the slides available. Open up a ticket if you find anything I should update or fix.
Please open up a discussion post in this repository if there are any questions or issues related to the slides, lectures or assignments. Feel free to comment and post you own entries to this discussion forum.
Syllabus
The following syllabus is an overview on the topics I plan to cover in this semester. Stay tuned!
Fun
- Programing: Expectations vs Reality [imgur]