Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Apache License 2.0
17.71k
stars
2.39k
forks
source link
UnconsumedParameterWarning: The configuration contains the parameter 'disable_persist_seconds' with value '604800' that is not consumed by the task 'scheduler'. #3205
UnconsumedParameterWarning: The configuration contains the parameter 'disable_persist_seconds' with value '604800' that is not consumed by the task 'scheduler'.
I'm getting this warning with Luigi 3.1.1:
This is a documented feature in https://luigi.readthedocs.io/en/stable/configuration.html#scheduler, and we use it to prolong the time a task remains disabled.