search

DataFabricRus / NiFi-GCD-Job-Runner

A processor for running Google Cloud Dataflow job from a template
MIT License
5 stars 3 forks source link

readme

NiFi-GCD-Job-Runner

A processor for running Google Cloud Dataflow job from a template

Prerequisites

The bundle is builded for Apache NiFi 1.8.0

How to use

  1. Clone the project and go to the project's root folder
  2. Build broject: mvn clean install
  3. Stop Apache NiFi service if it is working
  4. Copy built nars to Apache NiFi installation:
    • cp ./nifi-gcd-nar/target/nifi-gcd-nar-1.0.nar <Apache NiFi path>/nifi-assembly/target/nifi-1.8.0-bin/nifi-1.8.0/lib/
    • cp ./nifi-gcd-services-api-nar/target/nifi-gcd-services-api-nar-1.0.nar <Apache NiFi path>/nifi-assembly/target/nifi-1.8.0-bin/nifi-1.8.0/lib/
  5. Run Apache NiFi once again
  6. You should be able to add the ExecuteGCDataflowJob processor to your data flow

The examle demonstrating the usage of the processor can be found here. The example datailed usage demonstration could be found [TBD].