search

grillazz / fastapi-sqlalchemy-asyncpg

Integration of FastAPI framework supported by Pydantic with SQLAlchemy ORM and PostgreSQL on asyncpg driver
MIT License
415 stars 57 forks source link
asyncio asyncpg docker fastapi fastapi-sqlalchemy granian postgresql pydantic python python3 sqlalchemy uvicorn

readme

fastapi-sqlalchemy-asyncpg

Contributors Forks Stargazers Issues MIT License LinkedIn

fastapi-sqlalchemy-asyncpg

Table of Contents
  1. About The Project
  2. Getting Started
  3. Acknowledgments

About The Project

This example demonstrates the seamless integration of FastAPI, a modern, high-performance web framework, with Pydantic 2.0, a robust and powerful data validation library. The integration is further enhanced by the use of SQLAlchemy ORM, a popular and feature-rich Object-Relational Mapping tool, and PostgreSQL16 relational database.

The entire stack is connected using the asyncpg Database Client Library, which provides a robust and efficient way to interact with PostgreSQL databases in Python, leveraging the power of asyncio and event loops.

Notably, this example showcases the latest and greatest versions of SQLAlchemy and psycopg, which are renowned for their robustness, power, and speed. The inclusion of FastAPI adds a modern, fast, and high-performance web framework to the mix allowing for the rapid development of APIs with Python 3.8+.

FastAPI has received significant recognition in the industry, including a review on thoughtworks Technology Radar in April 2021, where it was classified as a Trial technology, with comments praising its performance, ease of use, and features such as API documentation using OpenAPI. Additionally, FastAPI was recognized in the Python Developers Survey 2022 Results, conducted by the Python Software Foundation and JetBrains, where it was reported that 1 in 4 Python developers use FastAPI, with a 4 percentage point increase from the previous year.

Built With

FastAPI Pydantic SQLAlchemy Uvicorn pytest asyncpg alembic rich

(back to top)

Getting Started

Make will help you

To build , run and test and more ... use magic of make help to play with this project.

1. make docker-build
2. make docker-up > alternatively > make docker-up-granian
3. make docker-apply-db-migrations
4. make docker-feed-database

(back to top)

How to feed database

It took me a while to find nice data set. Hope works of Shakespeare as example will be able to cover first part with read only declarative base configuration and all type of funny selects :) Data set is coming form https://github.com/catherinedevlin/opensourceshakespeare Next models were generated with https://github.com/agronholm/sqlacodegen

(back to top)

Rainbow logs with rich :rainbow:

To enhance the developer experience when viewing logs with extensive information from multiple emitters (which are particularly useful during development), this project uses the rich library. Event with the superpowers of rich, reading logs can be challenging. The rich library is highly beneficial, but integrating it properly as a logger object and maintaining it as a singleton took some effort.

To address the following needs:

he following steps were taken to integrate rich into the project:

  1. Configure emitters using the logging-uvicorn.json or use logging-granian.json for granian
  2. Eliminate duplicates, such as SQLAlchemy echo, by using separate handlers.
  3. Maintain the logger as a singleton to prevent multiple instances.
  4. Add the --log-config ./logging-uvicorn.json parameter to Uvicorn or --log-config ./logging-granian.json to Granian.

sample-logs-with-rich

(back to top)

Setup User Auth

Setup user authentication with JWT and Redis as token storage.

Local development with poetry

pyenv install 3.12 && pyenv local 3.12
poetry install --with dev

Hope you enjoy it.

Import xlsx files with polars and calamine

Power of Polars Library in data manipulation and analysis. It uses the polars library to read the Excel data into a DataFrame by passing the bytes to the pl.read_excel() function - https://docs.pola.rs/py-polars/html/reference/api/polars.read_excel.html In pl.read_excel() “calamine” engine can be used for reading all major types of Excel Workbook (.xlsx, .xlsb, .xls) and is dramatically faster than the other options, using the fastexcel module to bind calamine.

(back to top)

Worker aware async scheduler :clock1:

The project uses the APScheduler library to schedule tasks in the background. The APScheduler library is a powerful and flexible in-process task scheduler with Cron-like capabilities. It allows you to schedule jobs to run at specific times or intervals, and it supports multiple job stores, triggers, and executors. The library is designed to be easy to use and highly configurable, making it suitable for a wide range of use cases. It was added to project in version 4.0.0a5 with Redis as event broker and SQLAlchemy as data store.

(back to top)

Acknowledgments

Use this space to list resources you find helpful and would like to give credit to. I've included a few of my favorites to kick things off!

(back to top)

Change Log

(back to top)