search

cetic / helm-nifi

Helm Chart for Apache Nifi
Apache License 2.0
209 stars 221 forks source link

[cetic/nifi] Nifi node reconnecting issue #331

Open anmoln4 opened 5 months ago

anmoln4 commented 5 months ago

Problem :

Whenever a nifi node from nifi cluster disconnects and restart again . Sometimes it give error related to corrupted flow file.

This problem requires manual intervention. We have to delete flow.xm.gz and flow.json.gz file /opt/nifi/data folder and then restart that node. Then that node copies these files from primary node.

Solution: can we automate this process. Whenever this issue occurs , non-promary node archive the old flow file and copy new files from primary node.

wrender commented 5 months ago

We have this issue with NiFi nodes outside of Kubernetes as well. I think this type of thing should be considered outside of the scope of a NiFi helm chart. It's more of an application issue.