search

B23admin / nifi-stateless-operator

An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes
Apache License 2.0
53 stars 12 forks source link

Any documentation? #2

Open One946 opened 5 years ago

One946 commented 5 years ago

Hi, I was looking at this project and I was wondering if there's some documentation available, even some unofficial documentation would be nice. I'm trying to understand how does serverless nifi works, so any help would be very much appreciated.

dbkegley commented 5 years ago

Thanks for taking an interest in this project. There's currently no official documentation for the Nifi-fn operator. I started working on this before the functionality was officially merged into NiFi (it has since been renamed to nifi-stateless). This thread on the mailing list has the discussion on the initial proposal.

Here are the docs for nifi-stateless

The nifi-fn-operator is just a thin wrapper around the original project which makes the same functionality available to kubernetes as an operator.

One946 commented 5 years ago

Thank you. I really appreciate that you spend some of your time answering me, I'll try to wrap my head around those links!

M9T commented 4 years ago

Docs link is broken. Please provide a new link.

dbkegley commented 4 years ago

Sorry about that, here's the correct link

https://github.com/apache/nifi/tree/rel/nifi-1.10.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-stateless

supriyaK56 commented 4 years ago

@dbkegley I am trying to use nifi-stateless-operator as mentioned here https://github.com/B23admin/nifi-stateless-operator Its running successfully but while testing I am having some questions or may be issues:slightly_smiling_face:

  1. As per POC doc its saying flowfiles parameter is optional but its not allowing to run without flowflies --- https://github.com/apache/nifi/tree/rel/nifi-1.10.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-stateless While running with flowflies , the flow requires input port as mandatory
  2. And due to lack of documents I am not able to understand how nifi fn is running the flow . Its giving success on container logs but I am not getting any confirmation from nifi UI and not from nifi container.
dbkegley commented 4 years ago

@supriyaK56 Some of the background in this comment thread may be useful regarding [1] https://github.com/B23admin/nifi-stateless-operator/issues/8#issuecomment-534678530

For [2], there is no UI for nifi-stateless. If the nifi-fn container log is printing a success message then the flowfiles were able to finish processing without any errors. NiFi itself does not have any knowledge of the nifi-stateless flow so there will not be any useful info in the NiFi UI regarding the execution of nifi-stateless. Adding some LogMessage or DebugFlow processors to the stateless flow may help you trace the flowfiles as they move through the data flow