mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
MIT License
2.07k stars 100 forks source link

use echo_queries from mara_db.config.default_echo_queries #58

Closed ghost closed 3 years ago

ghost commented 3 years ago

Since mara_db version 4.7.1 the echo_queries parameter is by default taken from mara_db.config.default_echo_queries when it is None.

The config is by default set to True, so, we can safely remove all echo_queries=True calls in mara_pipeline. With this PR the mara_db.config.default_echo_queries config will apply to mara_pipeline as well.

ghost commented 3 years ago

@gathineou you merged already the PR in mara-db related to this, could you merge that here as well? The main purpose for this is to reduce the log size of my Jenkins job. Before I had 2 MB logs per execution, after applying this PR it is just 460 KB