Kubernetes NiFi Cluster

Apache NiFi supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

My goal is to show how to run Apache NiFi Cluster in Kubernetes

Prerequisites

• Kubernetes Cluster >= v1.23

Deployments

This will deploy Apache NiFi in a Cluster mode with extenal Apache Zookeeper managing ellections:

kubectl apply -k deployments/

NOTE: Remember to update Ingress hostname

This will create:

• 1x NiFi Namespace (all the items will be deployed here)
• 2x Apache NiFi Instances (can be increased)
• 1x Apache Zookeeper (accessible within the cluster only)
• 1x Secrets (basic auth username/passowrd: admin:admin)
• 1x Ingress (access endpoint)

:information_source: Set Ingress hostname to valid hostname before enabling it in kustomization.yml Important: Remeber to update the default username/password.

Services

kubectl get all,ing

Contributing

We would :heart: you to contribute by making a pull request.

Please read the official Contribution Guide for more information on how you can contribute.

Useful links:

• I Started NiFi. Now What?
• NiFi System Administrator’s Guide