Rebase from PR-738, add PythonOperatorPerArtifact option for airflow pipeline output.
Wrap each calculation block with pickle.load and pickle.dump if the calculation has input variables and return variables
Wrap dag tasks within the content manager
There is some potential for refactoring the PythonOperatorPerSession and PythonOperatorPerArtifact; however, I think it will make more sense to do it when implementing the DockerOperator.
Fixes # (issue)
LIN-531
Type of change
[x] New feature (non-breaking change which adds functionality)
How Has This Been Tested?
All local pipelines have been tested with local airflow
Description
pickle.loadandpickle.dumpif the calculation has input variables and return variablesThere is some potential for refactoring the PythonOperatorPerSession and PythonOperatorPerArtifact; however, I think it will make more sense to do it when implementing the DockerOperator.
Fixes # (issue)
LIN-531
Type of change
How Has This Been Tested?