d6t / d6tflow

Python library for building highly effective data science workflows
https://d6tflow.readthedocs.io/en/latest/
MIT License
951 stars 77 forks source link

Add `verbose` flag to disable all the output from `d6tflow.run(Task())` #9

Closed MarcoGorelli closed 5 years ago

MarcoGorelli commented 5 years ago

If I run

d6tflow.run(Task())

I get lots of output (the 'Luigi execution summary').

Granted, this is useful information, but sometimes I'd like to be able to just run a task without getting so much output.

Could we add a flag (e.g. verbose) which, if set to False, just runs the task without the Luigi execution summary getting displayed?

This is something I could work on, if you'd consider it worthwhile.

d6tdev commented 5 years ago

Already implemented, if you like to change/improve pls reopen https://d6tflow.readthedocs.io/en/latest/run.html#reducing-logging-output

d6tdev commented 4 years ago

Note that we just made some changes to reduce the luigi logging output which most users considered excessive. See https://d6tflow.readthedocs.io/en/latest/run.html#hiding-execution-output