antoinecarme / pyaf

PyAF is an Open Source Python library for Automatic Time Series Forecasting built on top of popular pydata modules.
BSD 3-Clause "New" or "Revised" License
459 stars 72 forks source link

Perform some tests with Python Multithreading without GIL #177

Open antoinecarme opened 2 years ago

antoinecarme commented 2 years ago

As of 2021, CPython implementation still uses the infamous "global interpreter lock (GIL)".

This is the design point behind PyAF using the multiprocessing module and not multithreading.

Now, there is a POC to remove the GIL for CPython (thanks to @colesbury ):

https://github.com/colesbury/nogil

The goal of this issue is to perform some initial tests with nogil and PyAF.

Not sure if this will help with the upcoming PyAF release (Probably later).

antoinecarme commented 2 years ago

Pre-built Docker image (Python 3.9 , Debian BullsEye):

https://hub.docker.com/r/colesbury/python-nogil