search

B23admin / b23-flowlib

0 stars 0 forks source link

[spike]: Investigate flow initialization from a NiFi Template as a method for migrating state #16

Closed dbkegley closed 5 years ago

dbkegley commented 5 years ago

If we utilize an external zookeeper, it may be possible to maintain state across NiFi pod restarts. Saving as a Template would maintain the processor ID, and initializing from a Template appears to let you set the value of a processor ID

We should look into creating a Template first during initialization, then deploying that template to the target NiFi instance.

Also, MiNiFi contains a yaml export too for converting a template to a yaml file https://nifi.apache.org/minifi/minifi-toolkit.html#getting-started

./config.sh transform ./root.xml root.yaml

it may prove valuable to update the flowlib data structure to be 1:1 compatible with this yaml structure so that we can deploy flowlib generated yaml to MiNiFi instances. Our data structure is already pretty close to this but has different field naming conventions

dbkegley commented 5 years ago

Templates do no maintain element ID after initialization