search

damavis / airflow-pentaho-plugin

Pentaho plugin for Apache Airflow - Orquestate pentaho transformations and jobs from Airflow
Apache License 2.0
38 stars 17 forks source link

How to set env variables ? #36

Open kleysonr opened 2 weeks ago

kleysonr commented 2 weeks ago

Hi.

I need to set a new KETTLE_HOME value for the DAG execution.

Is that possible ?

piffall commented 2 weeks ago

Yes, just follow this instructions assuming that "pentaho_home" is the same as KETTLE_HOME.

kleysonr commented 3 days ago

@piffall

I use a single kettle.properties inside each project to set the variables env dependent.

So when each dag runs, for each project, the pdi should read the kettle.properties inside the project folder.

I can't see how to use the pentaho_home as a solution per each individual kettle.properties files.

Can you provide an example of configuration for the use-case ?

Or, is it possible add a new extra parameter for kettle_home ?

Best Regards. Kleyson Rios.

piffall commented 3 days ago

Hi @kleysonr . In the case that you have kettle deployed multiple times and assuming that each of this paths contains a full deployment of PDI, you can just set multiple connections, each having pentaho_home pointing to corresponding path.

/opt/kettle_a
/opt/kettle_b
/opt/kettle_c