NiFi 2.0 adds support for python processors that can be used in flows.
These can be loaded by simply providing them in a directory on the pod and configuring NiFi to look into this directory.
NiFi also supports hot reloading of these processors out of the box, so this would be a perfect use case for a git-sync sidecar container, like we are using for Airflow already.
### Tasks
- [ ] Allow specifying a gitsync sidecar container (potentially with multiple repos)
- [ ] Mount repositories into the pods
- [ ] Configure NiFi to load processors from these mounts
NiFi 2.0 adds support for python processors that can be used in flows. These can be loaded by simply providing them in a directory on the pod and configuring NiFi to look into this directory. NiFi also supports hot reloading of these processors out of the box, so this would be a perfect use case for a git-sync sidecar container, like we are using for Airflow already.