webartifex / intro-to-python

An intro to Python & programming for wanna-be data scientists
https://code.webartifex.biz/alexander/intro-to-python
MIT License
912 stars 88 forks source link
data-science introduction-to-programming jupyter python tutorial

An Introduction to Python and Programming

This project is a thorough introductory course in programming with Python .

Table of Contents

The following is a high-level overview of the contents. For a more detailed version with clickable links see the CONTENTS.md file.

Videos

Presentations of the chapters are available on this YouTube playlist . The recordings are about 25 hours long in total and were made in spring 2020 after a corresponding in-class Bachelor course was cancelled due to Corona.

Objective

The main goal is to prepare students for further studies in the "field" of data science, including but not limited to topics such as:

Prerequisites

To be suitable for beginners, there are no formal prerequisites. It is only expected that the student has:

Getting started

If you are a total beginner, follow the instructions in the "Installation" section next. If you are familiar with the git and poetry command-line tools, you may want to look at the "Alternative Installation" section further below.

Installation

To follow this course, an installation of Python 3.11 or higher is expected.

A popular and beginner friendly way is to install the Anaconda Distribution that not only ships Python itself but also comes pre-packaged with a lot of third-party libraries.

Scroll down to the "Anaconda Installers" section and install the latest version for your operating system (i.e., 2024-02 with Python 3.11 at the time of this writing).

After installation, you find an entry "Anaconda Navigator" in your start menu. Click on it.

A window opens giving you several options to start various applications. In the beginning, we will work mostly with JupyterLab. Click on "Launch".

A new tab in your web browser opens: The website is "localhost" and some number (e.g., 8888).

This is the JupyterLab application that is used to display the course materials. On the left, you see the files and folders on your computer. This file browser works like any other. In the center, you see several options to launch (i.e., "create") new files.

To check if your Python installation works, double-click on the "Python 3" tile under the "Notebook" section. That opens a new Jupyter notebook named "Untitled.ipynb".

Enter some basic Python in the code cell, for example, 1 + 2. Then, press the Enter key while holding down the Control key (if that does not work, try with the Shift key) to execute the snippet. The result of the calculation, 3 in the example, shows up below the cell.

After setting up Python, click on the green "Code" button on the top right on this website to download the course materials. As a beginner, choosing "Download ZIP" is likely the easiest option. Then, unpack the ZIP file into a folder of your choice, ideally somewhere within your personal user folder so that the files show up right away in JupyterLab.

Alternative Installation (for Instructors using Linux)

Python can also be installed in a "pure" way obtained directly from its core development team here. Then, it comes without any third-party packages, which is not a problem at all. Managing third-party packages can be automated to a large degree, for example, with tools such as poetry.

However, this may be too "advanced" for a beginner as it involves working with a command-line interface (CLI), also called a terminal, which looks like the one below. It is used without a mouse by typing commands into it. The following instructions assume that git, poetry, and pyenv are installed.

The screenshot above shows how this project can be set up in an alternative way with the zsh CLI.

First, git is used to clone the course materials as a repository into a new folder called "intro-to-python" that lives under a "repos" folder.

The cd command is used to "change directories".

In the screenshot, pyenv is used to set the project's Python version. pyenv's purpose is to manage many parallel Python installations on the same computer. It is highly recommended for professional users; however, any other way of installing Python works as well.

On the contrary, poetry's purpose is to manage third-party packages within the same Python installation and, more importantly, on a per-project basis. So, for example, whereas "Project A" may depend on numpy v1.19 from June 2020 be installed, "Project B" may use v1.14 from January 2018 instead (cf., numpy's release history). To achieve this per-project isolation, poetry uses so-called virtual environments behind the scenes. While one could do that manually, for example, by using Python's built-in venv module, it is more convenient and reliable to have poetry automate this. The following one command not only creates a new virtual environment (manually: python -m venv venv) and activates it (manually: source venv/bin/activate), it also installs the versions of the project's third-party dependencies as specified in the poetry.lock file (manually: python -m pip install -r requirements.txt if a requirements.txt file is used; the python -m part is often left out but should not be):

poetry is also used to execute commands in the project's (virtual) environment. To do that, the command is prefixed with poetry run ....

The project uses nox to manage various maintenance tasks. After cloning the repository and setting up the virual environment, it is recommended to run the initialization task. That needs to be done only once.

To do the equivalent of clicking "Launch" in the Anaconda Navigator:

This opens a new tab in your web browser just as above. The command-line interface stays open in the background, like in the screenshot below, and prints log messages as we work in JupyterLab.

Contributing

Feedback is highly encouraged and will be incorporated. Open an issue in the issues tracker or initiate a pull request if you are familiar with the concept. Simple issues that anyone can help fix are, for example, spelling mistakes or broken links. If you feel that some topic is missing entirely, you may also mention that. The materials here are considered a permanent work-in-progress.

A "Show HN" post about this course was made on Hacker News and some ideas for improvement were discussed there.

About the Author

Alexander Hess is a PhD student at the Chair of Logistics Management at WHU - Otto Beisheim School of Management where he conducts research on urban delivery platforms and teaches coding courses based on Python in the BSc and MBA programs.

Connect him on LinkedIn.