At present, the OTRS DAG utilizes this old R script of Geoff's, launched via GKEPodOperator. It would be better to rewrite this script in Python and launch it via a BashOperator, as we do with most GCS and Dataflow scripts. That way we don't have to pay to run a GKE cluster just to handle this step, and it improves the overall coherence of the system (better to have everything in Python if possible).
At present, the OTRS DAG utilizes this old R script of Geoff's, launched via
GKEPodOperator
. It would be better to rewrite this script in Python and launch it via aBashOperator
, as we do with most GCS and Dataflow scripts. That way we don't have to pay to run a GKE cluster just to handle this step, and it improves the overall coherence of the system (better to have everything in Python if possible).