search

mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
MIT License
2.07k stars 100 forks source link

optimize code by using a multiprocessing context variable #26

Closed ice1e0 closed 4 years ago

ice1e0 commented 4 years ago

This will support different contexts at different parts of the application. See as well: https://docs.python.org/3/library/multiprocessing.html

martin-loetzsch commented 4 years ago

It's in master now, I re-added the comment in a second commit